| Package | Description | 
|---|---|
| com.actian.dataflow.cal.yarn.client | |
| com.pervasive.datarush.cal | 
 Provides interfaces the define the "cluster abstraction layer". 
 | 
| com.pervasive.datarush.graphs | 
 Provides classes and interfaces for the construction of executable
 dataflow graphs. 
 | 
| Modifier and Type | Method and Description | 
|---|---|
static com.pervasive.datarush.hadoop.shims.yarn.ResourceManagerClient | 
YarnShimFactory.createClient(ClusterSpecifier clusterSpec,
            ModuleConfiguration moduleCfg)
Get a client interface to the YARN Resource Manager. 
 | 
String | 
YarnClusterProvider.getDefaultStorageManagementPath(ClusterSpecifier spec)  | 
JobHistoryService | 
YarnClusterProvider.getJobHistoryService(FileClient fileClient,
                    ClusterSpecifier spec)  | 
boolean | 
YarnClusterProvider.isProviderFor(ClusterSpecifier spec)  | 
void | 
YarnClusterProvider.validateConnection(FileClient fileClient,
                  ClusterSpecifier spec)  | 
| Modifier and Type | Field and Description | 
|---|---|
static ClusterSpecifier | 
ClusterSpecifier.PSEUDO_DISTRIBUTED
Constant for the pseudo-distributed cluster 
 | 
| Modifier and Type | Method and Description | 
|---|---|
ClusterSpecifier | 
JobSpecifier.cluster()
Returns the cluster on which to run the job 
 | 
static ClusterSpecifier | 
ClusterSpecifier.create()
Returns a cluster specifier with default settings. 
 | 
ClusterSpecifier | 
ClusterSpecifier.host(String host)
Returns a new specifier with the host set to the specified value 
 | 
ClusterSpecifier | 
ClusterSpecifier.option(String name,
      List<String> value)
Returns a new specifier with the given option set to the specified value 
 | 
ClusterSpecifier | 
ClusterSpecifier.option(String name,
      String value)
Returns a new specifier with the given option set to the specified value 
 | 
ClusterSpecifier | 
ClusterSpecifier.options(Map<String,List<String>> options)
Returns a new specifier with the options set to the specified value 
 | 
static ClusterSpecifier | 
ClusterSpecifier.parse(String uristr)
Parses the given cluster specifier string. 
 | 
ClusterSpecifier | 
ClusterSpecifier.port(int port)
Returns a new specifier with the port set to the specified value 
 | 
ClusterSpecifier | 
ClusterSpecifier.scheme(String scheme)
Returns a new specifier with the scheme set to the specified value 
 | 
| Modifier and Type | Method and Description | 
|---|---|
JobSpecifier | 
JobSpecifier.cluster(ClusterSpecifier cluster)
Overrides the cluster 
 | 
String | 
ClusterProviderManager.getDefaultStorageManagementPath(ClusterSpecifier spec)
Returns the default root path for this cluster provider. 
 | 
String | 
ClusterProvider.getDefaultStorageManagementPath(ClusterSpecifier spec)
Returns the default root path for this cluster provider. 
 | 
JobHistoryService | 
ClusterProviderManager.getJobHistoryService(FileClient client,
                    ClusterSpecifier spec)  | 
JobHistoryService | 
ClusterProvider.getJobHistoryService(FileClient client,
                    ClusterSpecifier spec)  | 
ClusterProvider | 
ClusterProviderManager.getProvider(ClusterSpecifier spec)
Returns a provider that matches the given spec 
 | 
boolean | 
ClusterProvider.isProviderFor(ClusterSpecifier spec)
Returns whether this provider is the correct provider for the given specifier. 
 | 
void | 
ClusterProviderManager.validateConnection(FileClient client,
                  ClusterSpecifier spec)
Performs validation of the specifier 
 | 
void | 
ClusterProvider.validateConnection(FileClient fileClient,
                  ClusterSpecifier spec)
Gives the provider an opportunity to validate the specifier 
 | 
| Constructor and Description | 
|---|
JobSpecifier(ResourceSpecifier requestedResources,
            ClusterSpecifier cluster,
            ClasspathSpecifier classpath,
            JobInformation jobInformation,
            Path storageManagementPath)
Create a new job specifier 
 | 
JobSpecifier(ResourceSpecifier requestedResources,
            ClusterSpecifier cluster,
            ClasspathSpecifier classpath,
            JobInformation jobInformation,
            Path storageManagementPath,
            String schedulerQueue,
            List<String> extensionPaths)
Create a new job specifier 
 | 
| Modifier and Type | Field and Description | 
|---|---|
static EngineProperty<ClusterSpecifier> | 
EngineConfig.CLUSTER
Property controls which cluster to run on 
 | 
| Modifier and Type | Method and Description | 
|---|---|
ClusterSpecifier | 
EngineConfig.getCluster()
Returns the cluster specifier. 
 | 
| Modifier and Type | Method and Description | 
|---|---|
EngineConfig | 
EngineConfig.cluster(ClusterSpecifier spec)
Specifies the cluster on which we are to run 
 | 
Copyright © 2020 Actian Corporation. All rights reserved.