Module datarush.hadoop.core

Package com.actian.dataflow.cal.yarn.server

Class MasterServer

java.lang.Object

com.actian.dataflow.cal.yarn.server.MasterServer

public final class MasterServer
extends Object

The class invoked as the Dataflow application master. It is responsible for:

• Registering with the resource manager as an application master
• Registering with the Dataflow cluster manager (for stats)
• Supporting the file service interface for file transfers
• Supporting the remote service interface for gathering stats
• Negotiating with the resource manager for resources
• Starting/managing worker containers

Constructor Summary

Constructors

Constructor

Description

MasterServer(com.pervasive.datarush.hadoop.shims.yarn.AMRMClient amClient, FileClient client, Path drfsBaseDir, JobServerInformation jobWorkerInfo, JobSpecifier jobSpecifier, com.pervasive.datarush.cluster.ExecutorOptions execOptions, List<com.pervasive.datarush.hadoop.shims.yarn.YarnNodeDescriptor> nodeDescriptors, Path cacheLocation, Path libArchiveLocation, String applicationID, int jobPriority, com.pervasive.datarush.cluster.preferences.ClusterPreferences clusterPreferences, Map<String,ApplicationResource> appResources)

Method Summary

Modifier and Type	Method	Description
void	awaitShutdown()
InetSocketAddress	ensureService()
com.pervasive.datarush.cluster.PathInfo	getDRFSBaseInfo()
static void	main(String[] argv)
void	shutdown()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MasterServer

public MasterServer(com.pervasive.datarush.hadoop.shims.yarn.AMRMClient amClient,
                    FileClient client,
                    Path drfsBaseDir,
                    JobServerInformation jobWorkerInfo,
                    JobSpecifier jobSpecifier,
                    com.pervasive.datarush.cluster.ExecutorOptions execOptions,
                    List<com.pervasive.datarush.hadoop.shims.yarn.YarnNodeDescriptor> nodeDescriptors,
                    Path cacheLocation,
                    Path libArchiveLocation,
                    String applicationID,
                    int jobPriority,
                    com.pervasive.datarush.cluster.preferences.ClusterPreferences clusterPreferences,
                    Map<String,ApplicationResource> appResources)

Method Detail

ensureService

public InetSocketAddress ensureService()

shutdown

public void shutdown()

getDRFSBaseInfo

public com.pervasive.datarush.cluster.PathInfo getDRFSBaseInfo()

awaitShutdown

public void awaitShutdown()
                   throws InterruptedException

Throws:

InterruptedException

main

public static void main(String[] argv)
                 throws Exception

Throws:

Exception