Package | Description |
---|---|
com.actian.dataflow.cal.yarn.client | |
com.pervasive.datarush.cal |
Provides interfaces the define the "cluster abstraction layer".
|
com.pervasive.datarush.graphs |
Provides classes and interfaces for the construction of executable
dataflow graphs.
|
Modifier and Type | Method and Description |
---|---|
static com.pervasive.datarush.hadoop.shims.yarn.ResourceManagerClient |
YarnShimFactory.createClient(ClusterSpecifier clusterSpec,
ModuleConfiguration moduleCfg)
Get a client interface to the YARN Resource Manager.
|
String |
YarnClusterProvider.getDefaultStorageManagementPath(ClusterSpecifier spec) |
JobHistoryService |
YarnClusterProvider.getJobHistoryService(FileClient fileClient,
ClusterSpecifier spec) |
boolean |
YarnClusterProvider.isProviderFor(ClusterSpecifier spec) |
void |
YarnClusterProvider.validateConnection(FileClient fileClient,
ClusterSpecifier spec) |
Modifier and Type | Field and Description |
---|---|
static ClusterSpecifier |
ClusterSpecifier.PSEUDO_DISTRIBUTED
Constant for the pseudo-distributed cluster
|
Modifier and Type | Method and Description |
---|---|
ClusterSpecifier |
JobSpecifier.cluster()
Returns the cluster on which to run the job
|
static ClusterSpecifier |
ClusterSpecifier.create()
Returns a cluster specifier with default settings.
|
ClusterSpecifier |
ClusterSpecifier.host(String host)
Returns a new specifier with the host set to the specified value
|
ClusterSpecifier |
ClusterSpecifier.option(String name,
List<String> value)
Returns a new specifier with the given option set to the specified value
|
ClusterSpecifier |
ClusterSpecifier.option(String name,
String value)
Returns a new specifier with the given option set to the specified value
|
ClusterSpecifier |
ClusterSpecifier.options(Map<String,List<String>> options)
Returns a new specifier with the options set to the specified value
|
static ClusterSpecifier |
ClusterSpecifier.parse(String uristr)
Parses the given cluster specifier string.
|
ClusterSpecifier |
ClusterSpecifier.port(int port)
Returns a new specifier with the port set to the specified value
|
ClusterSpecifier |
ClusterSpecifier.scheme(String scheme)
Returns a new specifier with the scheme set to the specified value
|
Modifier and Type | Method and Description |
---|---|
JobSpecifier |
JobSpecifier.cluster(ClusterSpecifier cluster)
Overrides the cluster
|
String |
ClusterProviderManager.getDefaultStorageManagementPath(ClusterSpecifier spec)
Returns the default root path for this cluster provider.
|
String |
ClusterProvider.getDefaultStorageManagementPath(ClusterSpecifier spec)
Returns the default root path for this cluster provider.
|
JobHistoryService |
ClusterProviderManager.getJobHistoryService(FileClient client,
ClusterSpecifier spec) |
JobHistoryService |
ClusterProvider.getJobHistoryService(FileClient client,
ClusterSpecifier spec) |
ClusterProvider |
ClusterProviderManager.getProvider(ClusterSpecifier spec)
Returns a provider that matches the given spec
|
boolean |
ClusterProvider.isProviderFor(ClusterSpecifier spec)
Returns whether this provider is the correct provider for the given specifier.
|
void |
ClusterProviderManager.validateConnection(FileClient client,
ClusterSpecifier spec)
Performs validation of the specifier
|
void |
ClusterProvider.validateConnection(FileClient fileClient,
ClusterSpecifier spec)
Gives the provider an opportunity to validate the specifier
|
Constructor and Description |
---|
JobSpecifier(ResourceSpecifier requestedResources,
ClusterSpecifier cluster,
ClasspathSpecifier classpath,
JobInformation jobInformation,
Path storageManagementPath)
Create a new job specifier
|
JobSpecifier(ResourceSpecifier requestedResources,
ClusterSpecifier cluster,
ClasspathSpecifier classpath,
JobInformation jobInformation,
Path storageManagementPath,
String schedulerQueue,
List<String> extensionPaths)
Create a new job specifier
|
Modifier and Type | Field and Description |
---|---|
static EngineProperty<ClusterSpecifier> |
EngineConfig.CLUSTER
Property controls which cluster to run on
|
Modifier and Type | Method and Description |
---|---|
ClusterSpecifier |
EngineConfig.getCluster()
Returns the cluster specifier.
|
Modifier and Type | Method and Description |
---|---|
EngineConfig |
EngineConfig.cluster(ClusterSpecifier spec)
Specifies the cluster on which we are to run
|
Copyright © 2016 Actian Corporation. All rights reserved.