Package | Description |
---|---|
com.actian.dataflow.cal.yarn.client | |
com.actian.dataflow.cal.yarn.server | |
com.actian.dataflow.cal.yarn.shared | |
com.pervasive.datarush.cal |
Provides interfaces the define the "cluster abstraction layer".
|
com.pervasive.datarush.cal.dr | |
com.pervasive.datarush.cluster |
Provides classes and interfaces related to the management of
clustered dataflow engines.
|
Modifier and Type | Method and Description |
---|---|
JobExecutorService |
YarnClusterProvider.createExecutor(FileClient fileClient,
JobSpecifier spec) |
protected AbstractDRJobExecutor.JobMasterHelper |
YarnClusterJobExecutor.start(FileClient fileClient,
JobSpecifier jobSpec) |
Constructor and Description |
---|
YarnClusterJobExecutor(FileClient fileClient,
JobSpecifier jobSpec) |
Modifier and Type | Method and Description |
---|---|
JobSpecifier |
YarnWorkerArgs.getJobSpecifier() |
Constructor and Description |
---|
MasterServer(com.pervasive.datarush.hadoop.shims.yarn.AMRMClient amClient,
FileClient client,
Path drfsBaseDir,
JobServerInformation jobWorkerInfo,
JobSpecifier jobSpecifier,
ExecutorOptions execOptions,
List<com.pervasive.datarush.hadoop.shims.yarn.YarnNodeDescriptor> nodeDescriptors,
Path cacheLocation,
Path libArchiveLocation,
String applicationID,
int jobPriority,
ClusterPreferences clusterPreferences,
Map<String,ApplicationResource> appResources) |
PartitionServer(FileClient client,
Path drfsBaseDir,
String nodeID,
JobServerInformation jobWorkerInfo,
NodeAllocationProvider allocationProvider,
JobSpecifier jobSpecifier) |
YarnClusterExecutor(FileClient fileClient,
JobSpecifier jobSpec,
com.pervasive.datarush.hadoop.shims.yarn.ContainerManager containerMgr,
ExecutorOptions execOptions,
Path cacheLocation,
Path libArchiveLocation,
ClusterPreferences clusterPrefs,
Map<String,ApplicationResource> appResources) |
YarnWorkerArgs(JobSpecifier jobSpec,
ModuleConfiguration moduleConfiguration,
FileMetaConfiguration configuration,
NodeAllocationProvider provider) |
Modifier and Type | Method and Description |
---|---|
JobSpecifier |
YarnAppMasterArgs.getJobSpecifier() |
Constructor and Description |
---|
YarnAppMasterArgs(JobSpecifier jobSpec,
ModuleConfiguration moduleCfg,
FileMetaConfiguration fileCfg,
ClasspathSpecifier classpathSpec,
ExecutorOptions options,
List<com.pervasive.datarush.hadoop.shims.yarn.YarnNodeDescriptor> nodeDescriptors,
Path cacheLocation,
Path libArchiveLocation,
int jobPriority,
ClusterPreferences clusterPreferences,
Map<String,ApplicationResource> appResources) |
Modifier and Type | Method and Description |
---|---|
JobSpecifier |
JobSpecifier.classpath(ClasspathSpecifier classpath)
Overrides the classpath
|
JobSpecifier |
JobSpecifier.cluster(ClusterSpecifier cluster)
Overrides the cluster
|
JobSpecifier |
JobSpecifier.extensionPaths(List<String> extensionPaths)
Overrides the extension paths
|
JobSpecifier |
JobSpecifier.jobInformation(JobInformation jobInformation)
Overrides the jobInformation
|
JobSpecifier |
JobSpecifier.schedulerQueue(String schedulerQueue)
Overrides the scheduler queue
|
JobSpecifier |
JobSpecifier.storageManagementPath(Path storageManagementPath)
Overrides the storageManagementPath
|
Modifier and Type | Method and Description |
---|---|
JobExecutorService |
ClusterProviderManager.createExecutor(FileClient fileClient,
JobSpecifier spec)
Create a new job executor service.
|
JobExecutorService |
ClusterProvider.createExecutor(FileClient fileClient,
JobSpecifier spec)
Create a new job executor service.
|
static JobExecutorService |
JobExecutorServiceFactory.newJobExecutor(FileClient fileClient,
JobSpecifier jobSpec)
Creates a new executor
|
Constructor and Description |
---|
StorageManagerSpecifier(JobSpecifier jobSpec,
DistributedExecutorService service)
Create a jobInfo
|
Modifier and Type | Field and Description |
---|---|
protected JobSpecifier |
AbstractDRJobExecutor.jobSpec |
protected JobSpecifier |
AbstractDRClusterExecutor.jobSpec |
Modifier and Type | Method and Description |
---|---|
JobSpecifier |
DRClusterExecutor.getJobSpecifier() |
Modifier and Type | Method and Description |
---|---|
JobExecutorService |
PseudoDistributedClusterProvider.createExecutor(FileClient fileClient,
JobSpecifier jobSpec) |
JobExecutorService |
DRClusterProvider.createExecutor(FileClient fileClient,
JobSpecifier jobSpec) |
NodeAllocationPlan |
NodeAllocationProvider.ensureInitialNodeAllocation(FileClient client,
JobSpecifier jobSpec) |
NodeAllocationPlan |
EagerNodeAllocationProvider.ensureInitialNodeAllocation(FileClient client,
JobSpecifier jobSpec) |
protected AbstractDRJobExecutor.JobMasterHelper |
PseudoDistributedJobExecutor.start(FileClient fileClient,
JobSpecifier jobSpec) |
protected AbstractDRJobExecutor.JobMasterHelper |
DRClusterJobExecutor.start(FileClient fileClient,
JobSpecifier jobSpec) |
protected abstract AbstractDRJobExecutor.JobMasterHelper |
AbstractDRJobExecutor.start(FileClient fileClient,
JobSpecifier jobSpec) |
Constructor and Description |
---|
AbstractDRClusterExecutor(FileClient fileClient,
JobSpecifier jobSpec,
NodeAllocationProvider allocationProvider) |
AbstractDRJobExecutor(FileClient fileClient,
JobSpecifier jobSpec) |
DRClusterExecutor(FileClient fileClient,
JobSpecifier jobSpec,
ExecutorOptions execOptions,
NodeAllocationProvider allocationProvider,
ResourceAllocation masterResources) |
DRClusterJobExecutor(FileClient fileClient,
JobSpecifier jobSpec) |
PseudoDistributedClusterExecutor(FileClient fileClient,
JobSpecifier jobSpec) |
PseudoDistributedJobExecutor(FileClient fileClient,
JobSpecifier jobSpec) |
Constructor and Description |
---|
DistributedWorkerServiceImpl(NodeAllocationProvider allocationProvider,
FileClient fileClient,
String nodeID,
JobServerInformation jobServerInfo,
JobSpecifier jobSpec,
boolean wrap) |
WorkerServer(FileClient client,
Path drfsBaseDir,
String nodeID,
JobServerInformation jobWorkerInfo,
JobSpecifier jobSpecifier,
ExecutorOptions execOptions,
NodeAllocationProvider allocationProvider,
String host) |
Copyright © 2015 Actian Corporation. All Rights Reserved.