Module datarush.hadoop.core

Package com.actian.dataflow.cal.yarn.server

Class PartitionServer

java.lang.Object

com.actian.dataflow.cal.yarn.server.PartitionServer

public class PartitionServer
extends Object

The class invoked as the Dataflow partition server/worker. It is used as the main class of the containers launched through YARN to run dataflow graphs.

It is responsible for:

• Registering with the application master as a partition worker
• Supporting the file service interface for file transfers
• Supporting the remote service interface for gathering stats
• Executing partitions of dataflow jobs

Constructor Summary

Constructors

Constructor	Description
PartitionServer(FileClient client, Path drfsBaseDir, String nodeID, JobServerInformation jobWorkerInfo, com.pervasive.datarush.cal.dr.NodeAllocationProvider allocationProvider, JobSpecifier jobSpecifier)

Method Summary

Modifier and Type	Method	Description
com.pervasive.datarush.cluster.DistributedWorkerService	ensureService()
com.pervasive.datarush.cluster.PathInfo	getDRFSBaseInfo()
static void	main(String[] args)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PartitionServer

public PartitionServer(FileClient client,
                       Path drfsBaseDir,
                       String nodeID,
                       JobServerInformation jobWorkerInfo,
                       com.pervasive.datarush.cal.dr.NodeAllocationProvider allocationProvider,
                       JobSpecifier jobSpecifier)

Method Detail

ensureService

public com.pervasive.datarush.cluster.DistributedWorkerService ensureService()

getDRFSBaseInfo

public com.pervasive.datarush.cluster.PathInfo getDRFSBaseInfo()

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception