public class ReadStagingDataset extends AbstractReader
The staged data format is not splitable. To obtain parallelism, perform parallel writes to create a set of files; reads of the multiple files will be fully parallel.
WriteStagingDataset
options, output
Constructor and Description |
---|
ReadStagingDataset()
Reads an empty source with default settings.
|
ReadStagingDataset(ByteSource source)
Reads the specified data source using default
options.
|
ReadStagingDataset(Path path)
Reads the file specified by the path as staged data
using default options.
|
ReadStagingDataset(String pattern)
Reads all paths matching the specified pattern
as staged data using default options.
|
Modifier and Type | Method and Description |
---|---|
protected DataFormat |
computeFormat(CompositionContext ctx)
Determines the data format for the source.
|
DatasetMetadata |
discoverMetadata(FileClient client)
Gets the metadata for the currently configured data source.
|
compose, getExtraFieldAction, getFieldErrorAction, getFieldLengthThreshold, getIncludeSourceInfo, getMissingFieldAction, getOutput, getParseOptions, getPessimisticSplitting, getReadBuffer, getReadOnClient, getRecordWarningThreshold, getSelectedFields, getSource, getSplitOptions, getUseMetadata, setExtraFieldAction, setFieldErrorAction, setFieldLengthThreshold, setIncludeSourceInfo, setMissingFieldAction, setParseErrorAction, setParseOptions, setPessimisticSplitting, setReadBuffer, setReadOnClient, setRecordWarningThreshold, setSelectedFields, setSelectedFields, setSource, setSource, setSource, setSplitOptions, setUseMetadata
disableParallelism, getInputPorts, getOutputPorts, newInput, newInput, newOutput, newRecordInput, newRecordInput, newRecordOutput, notifyError
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
disableParallelism, getInputPorts, getOutputPorts
public ReadStagingDataset()
AbstractReader.setSource(ByteSource)
public ReadStagingDataset(String pattern)
pattern
- a path-matching patternFileClient.matchPaths(String)
public ReadStagingDataset(Path path)
path
- the path to readpublic ReadStagingDataset(ByteSource source)
source
- the data source to readprotected DataFormat computeFormat(CompositionContext ctx)
AbstractReader
ReadSource
operator. If an
implementation supports schema discovery, it must be
performed in this method.computeFormat
in class AbstractReader
ctx
- the composition context for the current invocation
of AbstractReader.compose(CompositionContext)
public DatasetMetadata discoverMetadata(FileClient client)
client
- the file clientCopyright © 2020 Actian Corporation. All rights reserved.