com.pervasive.datarush.cluster

Class NodeManagerImpl

java.lang.Object

com.pervasive.datarush.cluster.NodeManagerImpl

All Implemented Interfaces:

ClasspathCacheManager, NodeManager, WorkerServerHandle.Listener, SimpleRMI.ServerListener

public final class NodeManagerImpl
extends Object
implements NodeManager, SimpleRMI.ServerListener, WorkerServerHandle.Listener

Method Summary

Methods

Modifier and Type	Method and Description
OutputStream	addToCache(CacheScope scope, ClasspathKey key)
boolean	anyJobsRunning()
void	cleanup(GUID jobGUID, WorkerRole role, CleanupLevel level) Cleans up files created for the job
void	clearClasspathCache() Clears the shared classpath cache
WorkerService	createCommandExecutor(SerializationBridge<ClientWorkerServerArguments> arguments)
void	deleteJobLog(GUID jobId, WorkerRole role) Deletes the log file for the given job.
void	destroy() Called upon server shutdown.
Map<String,String>	getAllJobs() Gets the id of every job log mapped to it's name that is managed by this node.
Integer	getCommandServiceStatus(GUID guid, WorkerRole role) Get the current status of the command service associated with the job and role null - command service does not exist or has been terminated -1 - command service still executing 0 - command service execution completed normally 1+ - command service execution completed with error
NodeConfiguration	getConfiguration() Gets the current configuration settings for the node.
String	getJobName(GUID jobId) Gets the name of the job with the provided id.
long	getNodeLogAge(GUID jobId, WorkerRole role) Gets the age of the log files for the given job based on the last modification date.
Map<String,Long>	getNodeLogAge(WorkerRole role) Gets the age of all log files based on the last modification date mapped to job id.
JobLogInfo.LogInfo	getNodeLogInfo(GUID jobId, WorkerRole role) Get the log info for a job.
Map<String,JobLogInfo.LogInfo>	getNodeLogInfo(WorkerRole role) Gets a map of all job ids linked with the node's log info.
List<NodeStatistics>	getStatistics() Fetches statistics from each of the live processes launched by this node manager
String	getStatus() Gets a description of the current status of the node
String	getVersion() Returns the version number of this NodeManager instance
void	init(GenericTCPServer.ServerContext context) Called upon server start to inform the handler of context information such as the listening address.
NodeStatistics	killJob(GUID guid, WorkerRole role) Admin kill.
void	notifyNodePreferencesChanged(ClusterPreferences nodeScopedPreferences) Notifies the node manager that their preferences (may) have changed
Set<ClasspathKey>	notInNodeCache(Set<ClasspathKey> elements)
InputStream	openJobLogFile(GUID jobId, WorkerRole role, LogFileOptions options) Opens the log file for the given job.
InputStream	openNodeLogFile(LogFileOptions options) Opens the log file for the node manager.
void	processTerminated(com.pervasive.datarush.cluster.WorkerServerHandle handle)
void	rotateNodeLog() Rotates the node manager log
void	shutdown() Terminates the node manager.
static void	start(DataRushCluster cluster, String name, boolean daemon, String host)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

notifyNodePreferencesChanged

public void notifyNodePreferencesChanged(ClusterPreferences nodeScopedPreferences)

Description copied from interface: NodeManager

Notifies the node manager that their preferences (may) have changed

Specified by:

notifyNodePreferencesChanged in interface NodeManager

Parameters:

nodeScopedPreferences - the new preferences

getConfiguration

public NodeConfiguration getConfiguration()

Description copied from interface: NodeManager

Gets the current configuration settings for the node.

Specified by:

getConfiguration in interface NodeManager

Returns:

a description of current configuration

createCommandExecutor

public WorkerService createCommandExecutor(SerializationBridge<ClientWorkerServerArguments> arguments)

Specified by:

createCommandExecutor in interface NodeManager

getStatus

public String getStatus()

Description copied from interface: NodeManager

Gets a description of the current status of the node

Specified by:

getStatus in interface NodeManager

Returns:

a description of the node's status

shutdown

public void shutdown()

Description copied from interface: NodeManager

Terminates the node manager. Does not remove the node from the cluster manager registry.

Specified by:

shutdown in interface NodeManager

start

public static void start(DataRushCluster cluster,
         String name,
         boolean daemon,
         String host)

init

public void init(GenericTCPServer.ServerContext context)

Description copied from interface: SimpleRMI.ServerListener

Called upon server start to inform the handler of context information such as the listening address. This method will be called prior to accepting any requests.

Specified by:

init in interface SimpleRMI.ServerListener

Parameters:

context - the server context

destroy

public void destroy()

Description copied from interface: SimpleRMI.ServerListener

Called upon server shutdown. This method will be called only after the last request has finished.

Specified by:

destroy in interface SimpleRMI.ServerListener

getStatistics

public List<NodeStatistics> getStatistics()

Description copied from interface: NodeManager

Fetches statistics from each of the live processes launched by this node manager

Specified by:

getStatistics in interface NodeManager

Returns:

statistics from each of the live processes launched by this node manager

processTerminated

public void processTerminated(com.pervasive.datarush.cluster.WorkerServerHandle handle)

Specified by:

processTerminated in interface WorkerServerHandle.Listener

getCommandServiceStatus

public Integer getCommandServiceStatus(GUID guid,
                              WorkerRole role)

Description copied from interface: NodeManager

Get the current status of the command service associated with the job and role null - command service does not exist or has been terminated -1 - command service still executing 0 - command service execution completed normally 1+ - command service execution completed with error

Specified by:

getCommandServiceStatus in interface NodeManager

Parameters:

guid - the job guid

role - the role of the worker

Returns:

integer describing run status

killJob

public NodeStatistics killJob(GUID guid,
                     WorkerRole role)

Description copied from interface: NodeManager

Admin kill. This is also used by fault tolerance test cases since calling this first simulates a hard shutdown

Specified by:

killJob in interface NodeManager

role - the role of the worker to kill

Returns:

final statistics for the job or null if unable to obtain final statistics

See Also:

ClusterManager#killJob(GUID)}

getAllJobs

public Map<String,String> getAllJobs()

Description copied from interface: NodeManager

Gets the id of every job log mapped to it's name that is managed by this node.

Specified by:

getAllJobs in interface NodeManager

Returns:

map of ids to job names

getJobName

public String getJobName(GUID jobId)

Description copied from interface: NodeManager

Gets the name of the job with the provided id.

Specified by:

getJobName in interface NodeManager

Returns:

name of the job

getNodeLogAge

public Map<String,Long> getNodeLogAge(WorkerRole role)

Description copied from interface: NodeManager

Gets the age of all log files based on the last modification date mapped to job id.

Specified by:

getNodeLogAge in interface NodeManager

Parameters:

role - whether we want the log for the job master or the job

Returns:

map of job ids to log age

getNodeLogAge

public long getNodeLogAge(GUID jobId,
                 WorkerRole role)

Description copied from interface: NodeManager

Gets the age of the log files for the given job based on the last modification date.

Specified by:

getNodeLogAge in interface NodeManager

Parameters:

jobId - information used to determine the name of the log file

role - whether we want the log for the job master or the job

Returns:

the age in milliseconds since Epoch time

getNodeLogInfo

public Map<String,JobLogInfo.LogInfo> getNodeLogInfo(WorkerRole role)

Description copied from interface: NodeManager

Gets a map of all job ids linked with the node's log info.

Specified by:

getNodeLogInfo in interface NodeManager

Returns:

map of job ids to log info

getNodeLogInfo

public JobLogInfo.LogInfo getNodeLogInfo(GUID jobId,
                                WorkerRole role)

Description copied from interface: NodeManager

Get the log info for a job.

Specified by:

getNodeLogInfo in interface NodeManager

Parameters:

jobId - information used to determine the name of the log file

role - whether we want the log for the job master or the job

Returns:

the log info for the job on this node

openJobLogFile

public InputStream openJobLogFile(GUID jobId,
                         WorkerRole role,
                         LogFileOptions options)
                           throws IOException

Description copied from interface: NodeManager

Opens the log file for the given job. According to the specified options, this may either return the entire file or the last n bytes of the file.

Specified by:

openJobLogFile in interface NodeManager

Parameters:

jobId - information used to determine the name of the log file

role - whether we want the log for the job master or the job

Returns:

the file contents or null if it does not exist

Throws:

IOException - if a failure happens reading the file

deleteJobLog

public void deleteJobLog(GUID jobId,
                WorkerRole role)

Description copied from interface: NodeManager

Deletes the log file for the given job.

Specified by:

deleteJobLog in interface NodeManager

Parameters:

jobId - information used to determine the name of the log file

role - whether we want the log for the job master or the job

openNodeLogFile

public InputStream openNodeLogFile(LogFileOptions options)
                            throws IOException

Description copied from interface: NodeManager

Opens the log file for the node manager. According to the specified options, this may either return the entire file or the last n bytes of the file. This always opens the current node manager log file regardless of specified options.

Specified by:

openNodeLogFile in interface NodeManager

Returns:

the file contents

Throws:

IOException

cleanup

public void cleanup(GUID jobGUID,
           WorkerRole role,
           CleanupLevel level)

Description copied from interface: NodeManager

Cleans up files created for the job

Specified by:

cleanup in interface NodeManager

Parameters:

jobGUID - the job guid

level - the cleanup level.

notInNodeCache

public Set<ClasspathKey> notInNodeCache(Set<ClasspathKey> elements)

Specified by:

notInNodeCache in interface ClasspathCacheManager

addToCache

public OutputStream addToCache(CacheScope scope,
                      ClasspathKey key)
                        throws IOException

Specified by:

addToCache in interface ClasspathCacheManager

Throws:

IOException

clearClasspathCache

public void clearClasspathCache()
                         throws IOException

Description copied from interface: NodeManager

Clears the shared classpath cache

Specified by:

clearClasspathCache in interface NodeManager

Throws:

IOException - if unable to delete (would typically happen if job is running)

getVersion

public String getVersion()

Description copied from interface: NodeManager

Returns the version number of this NodeManager instance

Specified by:

getVersion in interface NodeManager

Returns:

anyJobsRunning

public boolean anyJobsRunning()
                       throws RMIException

Specified by:

anyJobsRunning in interface NodeManager

Throws:

RMIException

rotateNodeLog

public void rotateNodeLog()
                   throws RMIException

Description copied from interface: NodeManager

Rotates the node manager log

Specified by:

rotateNodeLog in interface NodeManager

Throws:

RMIException