| Package | Description | 
|---|---|
| com.actian.dataflow.cal.yarn.client | |
| com.actian.dataflow.cal.yarn.server | |
| com.actian.dataflow.cal.yarn.shared | |
| com.pervasive.datarush.cal | 
 Provides interfaces the define the "cluster abstraction layer". 
 | 
| Modifier and Type | Method and Description | 
|---|---|
JobExecutorService | 
YarnClusterProvider.createExecutor(FileClient fileClient,
              JobSpecifier spec)  | 
protected com.pervasive.datarush.cal.dr.AbstractDRJobExecutor.JobMasterHelper | 
YarnClusterJobExecutor.start(FileClient fileClient,
     JobSpecifier jobSpec)  | 
| Constructor and Description | 
|---|
YarnClusterJobExecutor(FileClient fileClient,
                      JobSpecifier jobSpec)  | 
| Modifier and Type | Method and Description | 
|---|---|
JobSpecifier | 
YarnWorkerArgs.getJobSpecifier()  | 
| Constructor and Description | 
|---|
MasterServer(com.pervasive.datarush.hadoop.shims.yarn.AMRMClient amClient,
            FileClient client,
            Path drfsBaseDir,
            JobServerInformation jobWorkerInfo,
            JobSpecifier jobSpecifier,
            com.pervasive.datarush.cluster.ExecutorOptions execOptions,
            List<com.pervasive.datarush.hadoop.shims.yarn.YarnNodeDescriptor> nodeDescriptors,
            Path cacheLocation,
            Path libArchiveLocation,
            String applicationID,
            int jobPriority,
            com.pervasive.datarush.cluster.preferences.ClusterPreferences clusterPreferences,
            Map<String,ApplicationResource> appResources)  | 
PartitionServer(FileClient client,
               Path drfsBaseDir,
               String nodeID,
               JobServerInformation jobWorkerInfo,
               com.pervasive.datarush.cal.dr.NodeAllocationProvider allocationProvider,
               JobSpecifier jobSpecifier)  | 
YarnClusterExecutor(FileClient fileClient,
                   JobSpecifier jobSpec,
                   com.pervasive.datarush.hadoop.shims.yarn.ContainerManager containerMgr,
                   com.pervasive.datarush.cluster.ExecutorOptions execOptions,
                   Path cacheLocation,
                   Path libArchiveLocation,
                   com.pervasive.datarush.cluster.preferences.ClusterPreferences clusterPrefs,
                   Map<String,ApplicationResource> appResources)  | 
YarnWorkerArgs(JobSpecifier jobSpec,
              ModuleConfiguration moduleConfiguration,
              FileMetaConfiguration configuration,
              com.pervasive.datarush.cal.dr.NodeAllocationProvider provider)  | 
| Modifier and Type | Method and Description | 
|---|---|
JobSpecifier | 
YarnAppMasterArgs.getJobSpecifier()  | 
| Constructor and Description | 
|---|
YarnAppMasterArgs(JobSpecifier jobSpec,
                 ModuleConfiguration moduleCfg,
                 FileMetaConfiguration fileCfg,
                 ClasspathSpecifier classpathSpec,
                 com.pervasive.datarush.cluster.ExecutorOptions options,
                 List<com.pervasive.datarush.hadoop.shims.yarn.YarnNodeDescriptor> nodeDescriptors,
                 Path cacheLocation,
                 Path libArchiveLocation,
                 int jobPriority,
                 com.pervasive.datarush.cluster.preferences.ClusterPreferences clusterPreferences,
                 Map<String,ApplicationResource> appResources)  | 
| Modifier and Type | Method and Description | 
|---|---|
JobSpecifier | 
JobSpecifier.classpath(ClasspathSpecifier classpath)
Overrides the classpath 
 | 
JobSpecifier | 
JobSpecifier.cluster(ClusterSpecifier cluster)
Overrides the cluster 
 | 
JobSpecifier | 
JobSpecifier.extensionPaths(List<String> extensionPaths)
Overrides the extension paths 
 | 
JobSpecifier | 
JobSpecifier.jobInformation(JobInformation jobInformation)
Overrides the jobInformation 
 | 
JobSpecifier | 
JobSpecifier.schedulerQueue(String schedulerQueue)
Overrides the scheduler queue 
 | 
JobSpecifier | 
JobSpecifier.storageManagementPath(Path storageManagementPath)
Overrides the storageManagementPath 
 | 
| Modifier and Type | Method and Description | 
|---|---|
JobExecutorService | 
ClusterProviderManager.createExecutor(FileClient fileClient,
              JobSpecifier spec)
Create a new job executor service. 
 | 
JobExecutorService | 
ClusterProvider.createExecutor(FileClient fileClient,
              JobSpecifier spec)
Create a new job executor service. 
 | 
static JobExecutorService | 
JobExecutorServiceFactory.newJobExecutor(FileClient fileClient,
              JobSpecifier jobSpec)
Creates a new executor 
 | 
| Constructor and Description | 
|---|
StorageManagerSpecifier(JobSpecifier jobSpec,
                       DistributedExecutorService service)
Create a jobInfo 
 | 
Copyright © 2020 Actian Corporation. All rights reserved.