Package | Description |
---|---|
com.actian.dataflow.cal.yarn.client | |
com.actian.dataflow.cal.yarn.server | |
com.actian.dataflow.cal.yarn.shared | |
com.pervasive.datarush.cal |
Provides interfaces the define the "cluster abstraction layer".
|
Modifier and Type | Method and Description |
---|---|
JobExecutorService |
YarnClusterProvider.createExecutor(FileClient fileClient,
JobSpecifier spec) |
protected com.pervasive.datarush.cal.dr.AbstractDRJobExecutor.JobMasterHelper |
YarnClusterJobExecutor.start(FileClient fileClient,
JobSpecifier jobSpec) |
Constructor and Description |
---|
YarnClusterJobExecutor(FileClient fileClient,
JobSpecifier jobSpec) |
Modifier and Type | Method and Description |
---|---|
JobSpecifier |
YarnWorkerArgs.getJobSpecifier() |
Constructor and Description |
---|
MasterServer(com.pervasive.datarush.hadoop.shims.yarn.AMRMClient amClient,
FileClient client,
Path drfsBaseDir,
JobServerInformation jobWorkerInfo,
JobSpecifier jobSpecifier,
com.pervasive.datarush.cluster.ExecutorOptions execOptions,
List<com.pervasive.datarush.hadoop.shims.yarn.YarnNodeDescriptor> nodeDescriptors,
Path cacheLocation,
Path libArchiveLocation,
String applicationID,
int jobPriority,
com.pervasive.datarush.cluster.preferences.ClusterPreferences clusterPreferences,
Map<String,ApplicationResource> appResources) |
PartitionServer(FileClient client,
Path drfsBaseDir,
String nodeID,
JobServerInformation jobWorkerInfo,
com.pervasive.datarush.cal.dr.NodeAllocationProvider allocationProvider,
JobSpecifier jobSpecifier) |
YarnClusterExecutor(FileClient fileClient,
JobSpecifier jobSpec,
com.pervasive.datarush.hadoop.shims.yarn.ContainerManager containerMgr,
com.pervasive.datarush.cluster.ExecutorOptions execOptions,
Path cacheLocation,
Path libArchiveLocation,
com.pervasive.datarush.cluster.preferences.ClusterPreferences clusterPrefs,
Map<String,ApplicationResource> appResources) |
YarnWorkerArgs(JobSpecifier jobSpec,
ModuleConfiguration moduleConfiguration,
FileMetaConfiguration configuration,
com.pervasive.datarush.cal.dr.NodeAllocationProvider provider) |
Modifier and Type | Method and Description |
---|---|
JobSpecifier |
YarnAppMasterArgs.getJobSpecifier() |
Constructor and Description |
---|
YarnAppMasterArgs(JobSpecifier jobSpec,
ModuleConfiguration moduleCfg,
FileMetaConfiguration fileCfg,
ClasspathSpecifier classpathSpec,
com.pervasive.datarush.cluster.ExecutorOptions options,
List<com.pervasive.datarush.hadoop.shims.yarn.YarnNodeDescriptor> nodeDescriptors,
Path cacheLocation,
Path libArchiveLocation,
int jobPriority,
com.pervasive.datarush.cluster.preferences.ClusterPreferences clusterPreferences,
Map<String,ApplicationResource> appResources) |
Modifier and Type | Method and Description |
---|---|
JobSpecifier |
JobSpecifier.classpath(ClasspathSpecifier classpath)
Overrides the classpath
|
JobSpecifier |
JobSpecifier.cluster(ClusterSpecifier cluster)
Overrides the cluster
|
JobSpecifier |
JobSpecifier.extensionPaths(List<String> extensionPaths)
Overrides the extension paths
|
JobSpecifier |
JobSpecifier.jobInformation(JobInformation jobInformation)
Overrides the jobInformation
|
JobSpecifier |
JobSpecifier.schedulerQueue(String schedulerQueue)
Overrides the scheduler queue
|
JobSpecifier |
JobSpecifier.storageManagementPath(Path storageManagementPath)
Overrides the storageManagementPath
|
Modifier and Type | Method and Description |
---|---|
JobExecutorService |
ClusterProviderManager.createExecutor(FileClient fileClient,
JobSpecifier spec)
Create a new job executor service.
|
JobExecutorService |
ClusterProvider.createExecutor(FileClient fileClient,
JobSpecifier spec)
Create a new job executor service.
|
static JobExecutorService |
JobExecutorServiceFactory.newJobExecutor(FileClient fileClient,
JobSpecifier jobSpec)
Creates a new executor
|
Constructor and Description |
---|
StorageManagerSpecifier(JobSpecifier jobSpec,
DistributedExecutorService service)
Create a jobInfo
|
Copyright © 2020 Actian Corporation. All rights reserved.