Module datarush.hadoop.core

Package com.actian.dataflow.cal.yarn.server

Class MasterServer

java.lang.Object

com.actian.dataflow.cal.yarn.server.MasterServer

public final class MasterServer
extends Object

The class invoked as the Dataflow application master. It is responsible for:

• Registering with the resource manager as an application master
• Registering with the Dataflow cluster manager (for stats)
• Supporting the file service interface for file transfers
• Supporting the remote service interface for gathering stats
• Negotiating with the resource manager for resources
• Starting/managing worker containers

Constructor Summary

Constructors

Constructor

Description

MasterServer(com.pervasive.datarush.hadoop.shims.yarn.AMRMClient amClient, FileClient client, Path drfsBaseDir, JobServerInformation jobWorkerInfo, JobSpecifier jobSpecifier, com.pervasive.datarush.cluster.ExecutorOptions execOptions, List<com.pervasive.datarush.hadoop.shims.yarn.YarnNodeDescriptor> nodeDescriptors, Path cacheLocation, Path libArchiveLocation, String applicationID, int jobPriority, com.pervasive.datarush.cluster.preferences.ClusterPreferences clusterPreferences, Map<String,ApplicationResource> appResources)

Method Summary

Modifier and Type	Method	Description
void	awaitShutdown()
InetSocketAddress	ensureService()
com.pervasive.datarush.cluster.PathInfo	getDRFSBaseInfo()
static void	main(String[] argv)
void	shutdown()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

MasterServer

public MasterServer(com.pervasive.datarush.hadoop.shims.yarn.AMRMClient amClient,
 FileClient client,
 Path drfsBaseDir,
 JobServerInformation jobWorkerInfo,
 JobSpecifier jobSpecifier,
 com.pervasive.datarush.cluster.ExecutorOptions execOptions,
 List<com.pervasive.datarush.hadoop.shims.yarn.YarnNodeDescriptor> nodeDescriptors,
 Path cacheLocation,
 Path libArchiveLocation,
 String applicationID,
 int jobPriority,
 com.pervasive.datarush.cluster.preferences.ClusterPreferences clusterPreferences,
 Map<String,ApplicationResource> appResources)

Method Details

ensureService

public InetSocketAddress ensureService()

shutdown

public void shutdown()

getDRFSBaseInfo

public com.pervasive.datarush.cluster.PathInfo getDRFSBaseInfo()

awaitShutdown

public void awaitShutdown()
                   throws InterruptedException

Throws:

InterruptedException

main

public static void main(String[] argv)
                 throws Exception

Throws:

Exception