Uses of Class
com.pervasive.datarush.io.FileClient

Packages that use FileClient

Package	Description
com.actian.dataflow.cal.yarn.client
com.actian.dataflow.cal.yarn.server
com.actian.dataflow.cal.yarn.shared
com.actian.dataflow.operators.io.orc
com.actian.dataflow.operators.io.parquet
com.pervasive.datarush.analytics.pmml	Provides shared and base classes for PMML model representation of Analytics algorithms.
com.pervasive.datarush.aws.s3
com.pervasive.datarush.cal	Provides interfaces the define the "cluster abstraction layer".
com.pervasive.datarush.io	Provides classes and interfaces performing file-like I/O operations.
com.pervasive.datarush.io.compression	Provides classes and interfaces for supporting data compression.
com.pervasive.datarush.operators	Provides classes and interfaces for developing dataflow operators.
com.pervasive.datarush.operators.io	Provides base file I/O components including encoders and decoders.
com.pervasive.datarush.operators.io.avro	Provides operators for reading and writing files in Avro format.
com.pervasive.datarush.operators.io.staging	Provides operators for reading and writing DataRush staging datasets.
com.pervasive.datarush.operators.io.textfile	Provides operators for reading and writing text data.

Uses of FileClient in com.actian.dataflow.cal.yarn.client

Methods in com.actian.dataflow.cal.yarn.client with parameters of type FileClient

Modifier and Type	Method and Description
JobExecutorService	YarnClusterProvider.createExecutor(FileClient fileClient, JobSpecifier spec)
JobHistoryService	YarnClusterProvider.getJobHistoryService(FileClient fileClient, ClusterSpecifier spec)
protected com.pervasive.datarush.cal.dr.AbstractDRJobExecutor.JobMasterHelper	YarnClusterJobExecutor.start(FileClient fileClient, JobSpecifier jobSpec)
void	YarnClusterProvider.validateConnection(FileClient fileClient, ClusterSpecifier spec)

Constructors in com.actian.dataflow.cal.yarn.client with parameters of type FileClient

Constructor and Description
YarnClusterJobExecutor(FileClient fileClient, JobSpecifier jobSpec)

Uses of FileClient in com.actian.dataflow.cal.yarn.server

Constructors in com.actian.dataflow.cal.yarn.server with parameters of type FileClient

Constructor and Description
MasterServer(com.pervasive.datarush.hadoop.shims.yarn.AMRMClient amClient, FileClient client, Path drfsBaseDir, JobServerInformation jobWorkerInfo, JobSpecifier jobSpecifier, com.pervasive.datarush.cluster.ExecutorOptions execOptions, List<com.pervasive.datarush.hadoop.shims.yarn.YarnNodeDescriptor> nodeDescriptors, Path cacheLocation, Path libArchiveLocation, String applicationID, int jobPriority, com.pervasive.datarush.cluster.preferences.ClusterPreferences clusterPreferences, Map<String,ApplicationResource> appResources)
PartitionServer(FileClient client, Path drfsBaseDir, String nodeID, JobServerInformation jobWorkerInfo, com.pervasive.datarush.cal.dr.NodeAllocationProvider allocationProvider, JobSpecifier jobSpecifier)
YarnClusterExecutor(FileClient fileClient, JobSpecifier jobSpec, com.pervasive.datarush.hadoop.shims.yarn.ContainerManager containerMgr, com.pervasive.datarush.cluster.ExecutorOptions execOptions, Path cacheLocation, Path libArchiveLocation, com.pervasive.datarush.cluster.preferences.ClusterPreferences clusterPrefs, Map<String,ApplicationResource> appResources)

Uses of FileClient in com.actian.dataflow.cal.yarn.shared

Constructors in com.actian.dataflow.cal.yarn.shared with parameters of type FileClient

Constructor and Description
DatafileStagingManager(FileClient client, Path stagingLocation, GUID jobId)

Uses of FileClient in com.actian.dataflow.operators.io.orc

Methods in com.actian.dataflow.operators.io.orc with parameters of type FileClient

Modifier and Type	Method and Description
ORCMetadata	ReadORC.discoverMetadata(FileClient client) Gets the metadata for the currently configured data source.
FileMetadata	ORCFormat.readMetadata(FileClient fileClient, ByteSource source)
void	ORCFormat.writeMetadata(FileMetadata metadata, FileClient fileClient, ByteSink target)

Uses of FileClient in com.actian.dataflow.operators.io.parquet

Methods in com.actian.dataflow.operators.io.parquet with parameters of type FileClient

Modifier and Type	Method and Description
ParquetMetadata	ReadParquet.discoverMetadata(FileClient client) Gets the metadata for the currently configured data source.
FileMetadata	ParquetFormat.readMetadata(FileClient fileClient, ByteSource source)
void	ParquetFormat.writeMetadata(FileMetadata metadata, FileClient fileClient, ByteSink target)

Uses of FileClient in com.pervasive.datarush.analytics.pmml

Methods in com.pervasive.datarush.analytics.pmml with parameters of type FileClient

Modifier and Type	Method and Description
static Document	PMML.parsePMML(FileClient client, String filePath) Validates the PMML against the latest schema and parses

Uses of FileClient in com.pervasive.datarush.aws.s3

Methods in com.pervasive.datarush.aws.s3 with parameters of type FileClient

Modifier and Type	Method and Description
FileSystem	S3FileSystemProvider.getFileSystem(FileClient client, FileConfiguration configuration, Path path)

Uses of FileClient in com.pervasive.datarush.cal

Methods in com.pervasive.datarush.cal that return FileClient

Modifier and Type	Method and Description
FileClient	JobContext.getFileClient() Returns the file client to be used within this context
FileClient	DistributedCallableContextBatch.getFileClient() Returns the file client to be used within this context
FileClient	DistributedCallableContext.getFileClient() Returns the file client to be used within this context

Methods in com.pervasive.datarush.cal with parameters of type FileClient

Modifier and Type	Method and Description
JobExecutorService	ClusterProviderManager.createExecutor(FileClient fileClient, JobSpecifier spec) Create a new job executor service.
JobExecutorService	ClusterProvider.createExecutor(FileClient fileClient, JobSpecifier spec) Create a new job executor service.
JobHistoryService	ClusterProviderManager.getJobHistoryService(FileClient client, ClusterSpecifier spec)
JobHistoryService	ClusterProvider.getJobHistoryService(FileClient client, ClusterSpecifier spec)
static JobExecutorService	JobExecutorServiceFactory.newJobExecutor(FileClient fileClient, JobSpecifier jobSpec) Creates a new executor
void	StorageManager.releaseStorage(FileClient client) Releases all storage for this storage manager
void	StorageManager.releaseStorage(FileClient fileClient, StoragePlanner storagePlanner) Releases all storage for this storage manager that was allocated by the given planner
void	JobContext.releaseStorage(FileClient fileClient, StoragePlanner storagePlanner) Releases all storage for this storage manager that was allocated by the given planner.
void	ClusterProviderManager.validateConnection(FileClient client, ClusterSpecifier spec) Performs validation of the specifier
void	ClusterProvider.validateConnection(FileClient fileClient, ClusterSpecifier spec) Gives the provider an opportunity to validate the specifier

Uses of FileClient in com.pervasive.datarush.io

Methods in com.pervasive.datarush.io that return FileClient

Modifier and Type	Method and Description
static FileClient	FileClient.basicClient() Creates a new client only using the OS-level credentials inherited from the JVM's execution environment.
static FileClient	FileClient.configuredClient(FileMetaConfiguration configuration, ModuleConfiguration moduleConfiguration) Creates a new client, authorized according to the given configuration.
static FileClient	FileClient.configuredClient(FileMetaConfiguration configuration, ModuleConfiguration moduleConfiguration, File indexPathBase, Path[] tempFsRootDirs) Creates a new client, authorized according to the given configuration.
FileClient	FileSplit.getFileClient() Return the file client associated with this split.
FileClient	DataSplit.getFileClient() Return the file client associated with this split.
FileClient	FileClient.instrumentWith(IOMonitoringContext monitor) Creates a new client which instrumented I/O operations using the specified context.
FileClient	FileClient.withNetworkConfiguration(NetworkConfiguration networkConfiguration) Creates a new client with the specified network configuration.

Methods in com.pervasive.datarush.io with parameters of type FileClient

Modifier and Type	Method and Description
FileSplit	SplittableCompressedFileSplit.authorize(FileClient client)
FileSplit	FileSplit.authorize(FileClient client)
DataSplit	DataSplit.authorize(FileClient client) Creates an identical split which will use the specified authorization context for access.
FileSplit	CompressedFileSplit.authorize(FileClient client)
static InputStreamSupplier	InputStreamSuppliers.combine(FileClient client, List<Path> paths, boolean ignoreNonExistant) Creates an InputStreamSupplier that will return an input stream consisting of the streams of each of the sources, combined together.
static InputStreamSupplier	InputStreamSuppliers.concat(FileClient client, List<Path> paths) Creates an InputStreamSupplier that will return an input stream consisting of the streams of each of the paths, concatenated together.
static InputStreamSupplier	InputStreamSuppliers.concat(FileClient client, List<Path> paths, boolean ignoreNonExistent) Creates an InputStreamSupplier that will return an input stream consisting of the streams of each of the paths, concatenated together.
FileSystem	HadoopFileSystemProvider.getFileSystem(FileClient client, FileConfiguration configuration, Path path)
FileSystem	URLFileSystemProvider.getFileSystem(FileClient client, FileConfiguration configuration, Path path)
FileSystem	SFTPFileSystemProvider.getFileSystem(FileClient client, FileConfiguration configuration, Path path)
FileSystem	LocalFileSystemProvider.getFileSystem(FileClient client, FileConfiguration configuration, Path path)
FileSystem	FileSystemProvider.getFileSystem(FileClient client, FileConfiguration configuration, Path path) Gets the file system identified by the path.
FileSystem	FTPFileSystemProvider.getFileSystem(FileClient client, FileConfiguration configuration, Path path)
FileSystem	BuiltinStreamProvider.getFileSystem(FileClient fileClient, FileConfiguration configuration, Path path)
static InputStreamSupplier	InputStreamSuppliers.path(FileClient client, Path path) Returns an InputStreamSupplier that will open the specified path.
static InputStreamSupplier	InputStreamSuppliers.path(FileClient client, Path path, boolean ignoreNonExistent) Returns an InputStreamSupplier that will open the specified path.

Uses of FileClient in com.pervasive.datarush.io.compression

Methods in com.pervasive.datarush.io.compression with parameters of type FileClient

Modifier and Type	Method and Description
SplitIterator	UncompressedData.getSplitIterator(FileClient client, Path filePath, SplitOptions options)
SplitIterator	SnappyCompression.getSplitIterator(FileClient client, Path filePath, SplitOptions options)
SplitIterator	GZipCompression.getSplitIterator(FileClient client, Path filePath, SplitOptions options)
SplitIterator	CompressionFormat.getSplitIterator(FileClient client, Path filePath, SplitOptions options) Create a SplitIterator for the given file path and options.
SplitIterator	BZipCompression.getSplitIterator(FileClient client, Path filePath, SplitOptions options)

Uses of FileClient in com.pervasive.datarush.operators

Methods in com.pervasive.datarush.operators that return FileClient

Modifier and Type	Method and Description
FileClient	MetadataContext.getFileClient() Returns the file client to be used within the graph
FileClient	ExecutionContext.getFileClient() Returns the file client to be used within the graph

Uses of FileClient in com.pervasive.datarush.operators.io

Methods in com.pervasive.datarush.operators.io with parameters of type FileClient

Modifier and Type	Method and Description
ByteSource	GlobbingByteSource.authorize(FileClient client)
ByteSource	ConcatenatedByteSource.authorize(FileClient client)
ByteSource	ByteSource.authorize(FileClient client) Creates a new source with the same properties, but using the specified authorization.
ByteSink	ByteSink.authorize(FileClient client) Creates a new sink with the same properties, but using the specified authorization.
ByteSource	BasicByteSource.authorize(FileClient client)
ByteSink	BasicByteSink.authorize(FileClient client)
FileMetadata	DataFormat.readMetadata(FileClient fileClient, ByteSource source) Reads the metadata associated with the format.
void	DataFormat.writeMetadata(FileMetadata metadata, FileClient fileClient, ByteSink target) Writes the provided metadata associated with the format.

Uses of FileClient in com.pervasive.datarush.operators.io.avro

Methods in com.pervasive.datarush.operators.io.avro with parameters of type FileClient

Modifier and Type	Method and Description
AvroMetadata	ReadAvro.discoverMetadata(FileClient client) Gets the metadata for the currently configured data source.
static AvroMetadata	AvroMetadata.load(FileClient fileClient, File file) Loads metadata from the specified Avro formatted file.
static AvroMetadata	AvroMetadata.load(FileClient fileClient, Path path) Loads metadata from the specified Avro formatted file.
static AvroMetadata	AvroMetadata.load(FileClient fileClient, String fileName) Loads metadata from the specified Avro formatted file.
FileMetadata	AvroFormat.readMetadata(FileClient fileClient, ByteSource source)
void	AvroFormat.writeMetadata(FileMetadata metadata, FileClient fileClient, ByteSink target)

Uses of FileClient in com.pervasive.datarush.operators.io.staging

Methods in com.pervasive.datarush.operators.io.staging with parameters of type FileClient

Modifier and Type	Method and Description
DatasetMetadata	WriteStagingDataset.discoverMetadata(FileClient client) Gets the metadata for the currently configured data target.
DatasetMetadata	ReadStagingDataset.discoverMetadata(FileClient client) Gets the metadata for the currently configured data source.

Constructors in com.pervasive.datarush.operators.io.staging with parameters of type FileClient

Constructor and Description
DatasetBuilder(FileClient client, Path dataset, int bufferSize, TokenEncodings baseEncodings, RecordTokenType type, WriteMode mode, int blockSize) Creates and opens the builder.
DatasetBuilder(FileClient client, String dataset, int bufferSize, TokenEncodings baseEncodings, WriteMode mode, RecordTokenType type) Creates and opens the builder.
DatasetIterator(FileClient fileClient, Path dataset, int bufferSize, TokenEncodings baseEncodings) Creates and opens the iterator.
DatasetIterator(FileClient fileClient, String dataset, int bufferSize, TokenEncodings baseEncodings) Creates and opens the iterator.
DatasetMetadata(FileClient fileClient, File dataset) Creates a DatasetMetadata for an existing dataset.
DatasetMetadata(FileClient fileClient, Path dataset) Creates a DatasetMetadata for an existing dataset.
DatasetMetadata(FileClient fileClient, String datasetName) Creates a DatasetMetadata for an existing dataset.

Uses of FileClient in com.pervasive.datarush.operators.io.textfile

Methods in com.pervasive.datarush.operators.io.textfile with parameters of type FileClient

Modifier and Type	Method and Description
FormatAnalyzer.FormatAnalysis	FormatAnalyzer.analyze(Path file, CharsetEncoding encoding, FileClient client) Analyze the specified file expecting the described character set encoding.
DelimitedTextAnalyzer.Analysis	DelimitedTextAnalyzer.analyze(Path file, CharsetEncoding charsetSpec, FileClient client) Analyzes the specified file based on current configuration.
ARFFAnalyzer.Analysis	ARFFAnalyzer.analyze(Path file, CharsetEncoding encoding, FileClient client) Analyze the specified ARFF file expecting the described character set encoding.
void	ReadDelimitedText.autoConfigure(FileClient ctx) Performs any configured discovery on the operator using the current source and applies the result to configuration.
FormatAnalyzer.FormatAnalysis	ReadLog.discoverMetadata(FileClient ctx)
ARFFAnalyzer.Analysis	ReadARFF.discoverMetadata(FileClient ctx) Gets the metadata for the currently configured data source.
RecordTextSchema<?>	ReadDelimitedText.discoverSchema(FileClient ctx) Run schema discovery using current configuration.
FileMetadata	LogDataFormat.readMetadata(FileClient fileClient, ByteSource source)
FileMetadata	FixedTextFormat.readMetadata(FileClient fileClient, ByteSource source)
FileMetadata	DelimitedTextFormat.readMetadata(FileClient fileClient, ByteSource source)
FileMetadata	ARFFDataFormat.readMetadata(FileClient fileClient, ByteSource source)
void	LogDataFormat.writeMetadata(FileMetadata metadata, FileClient fileClient, ByteSink target)
void	FixedTextFormat.writeMetadata(FileMetadata metadata, FileClient fileClient, ByteSink target)
void	DelimitedTextFormat.writeMetadata(FileMetadata metadata, FileClient fileClient, ByteSink target)
void	ARFFDataFormat.writeMetadata(FileMetadata metadata, FileClient fileClient, ByteSink target)