com.actian.dataflow.cal.yarn.server

Class PartitionServer

java.lang.Object

com.actian.dataflow.cal.yarn.server.PartitionServer

public class PartitionServer
extends Object

The class invoked as the Dataflow partition server/worker. It is used as the main class of the containers launched through YARN to run dataflow graphs.

It is responsible for:

• Registering with the application master as a partition worker
• Supporting the file service interface for file transfers
• Supporting the remote service interface for gathering stats
• Executing partitions of dataflow jobs

Constructor Summary

Constructors

Constructor and Description
PartitionServer(FileClient client, Path drfsBaseDir, String nodeID, JobServerInformation jobWorkerInfo, NodeAllocationProvider allocationProvider, JobSpecifier jobSpecifier)

Method Summary

Methods

Modifier and Type	Method and Description
DistributedWorkerService	ensureService()
PathInfo	getDRFSBaseInfo()
static void	main(String[] args)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PartitionServer

public PartitionServer(FileClient client,
               Path drfsBaseDir,
               String nodeID,
               JobServerInformation jobWorkerInfo,
               NodeAllocationProvider allocationProvider,
               JobSpecifier jobSpecifier)

Method Detail

ensureService

public DistributedWorkerService ensureService()

getDRFSBaseInfo

public PathInfo getDRFSBaseInfo()

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception