public class YarnClusterProvider extends Object implements ClusterProvider
ClusterProvider interface that supports interacting
with a YARN-based Hadoop cluster. This is the entry point into providing the needed
services for interacting with YARN.
The cluster specifier uses the scheme yarn. The host name and port are the
address of the Dataflow Cluster Manager. The Cluster Manager is used as the gateway
into YARN. Hadoop configuration information can be bootstrapped from the Cluster
Manager and used to create initial connections into the YARN Resource Manager.
Constructor and Description |
---|
YarnClusterProvider() |
Modifier and Type | Method and Description |
---|---|
JobExecutorService |
createExecutor(FileClient fileClient,
JobSpecifier spec)
Create a new job executor service.
|
String |
getDefaultStorageManagementPath(ClusterSpecifier spec)
Returns the default root path for this cluster provider.
|
JobHistoryService |
getJobHistoryService(FileClient fileClient,
ClusterSpecifier spec) |
boolean |
isProviderFor(ClusterSpecifier spec)
Returns whether this provider is the correct provider for the given specifier.
|
void |
validateConnection(FileClient fileClient,
ClusterSpecifier spec)
Gives the provider an opportunity to validate the specifier
|
public static final String PROTOCOL
public boolean isProviderFor(ClusterSpecifier spec)
ClusterProvider
isProviderFor
in interface ClusterProvider
spec
- the specifierpublic void validateConnection(FileClient fileClient, ClusterSpecifier spec)
ClusterProvider
validateConnection
in interface ClusterProvider
spec
- the specifierpublic String getDefaultStorageManagementPath(ClusterSpecifier spec)
ClusterProvider
getDefaultStorageManagementPath
in interface ClusterProvider
spec
- the cluster specifierpublic JobExecutorService createExecutor(FileClient fileClient, JobSpecifier spec)
ClusterProvider
createExecutor
in interface ClusterProvider
fileClient
- the file client to usespec
- the job specifierpublic JobHistoryService getJobHistoryService(FileClient fileClient, ClusterSpecifier spec)
getJobHistoryService
in interface ClusterProvider
Copyright © 2024 Actian Corporation. All rights reserved.