Module dataflow.hadoop.hive

Package com.actian.dataflow.operators.io.orc

Class ReadORC

java.lang.Object

com.pervasive.datarush.operators.AbstractLogicalOperator

com.pervasive.datarush.operators.CompositeOperator

com.pervasive.datarush.operators.io.AbstractReader

com.actian.dataflow.operators.io.orc.ReadORC

All Implemented Interfaces:

LogicalOperator, RecordSourceOperator, SourceOperator<RecordPort>

public class ReadORC
extends AbstractReader

Field Summary

Fields inherited from class com.pervasive.datarush.operators.io.AbstractReader

options, output

Constructor Summary

Constructors

Constructor	Description
ReadORC()	Reads an empty source with default settings.
ReadORC(Path path)	Reads the file specified by the path.
ReadORC(ByteSource source)	Reads the specified data source using default options.
ReadORC(String pattern)	Reads all paths matching the specified pattern using default options.

Method Summary

Modifier and Type	Method	Description
protected DataFormat	computeFormat(CompositionContext ctx)	Determines the data format for the source.
ORCMetadata	discoverMetadata(FileClient client)	Gets the metadata for the currently configured data source.

Methods inherited from class com.pervasive.datarush.operators.io.AbstractReader

compose, getExtraFieldAction, getFieldErrorAction, getFieldLengthThreshold, getIncludeSourceInfo, getMissingFieldAction, getOutput, getParseOptions, getPessimisticSplitting, getReadBuffer, getReadOnClient, getRecordWarningThreshold, getSelectedFields, getSource, getSplitOptions, getUseMetadata, setExtraFieldAction, setFieldErrorAction, setFieldLengthThreshold, setIncludeSourceInfo, setMissingFieldAction, setParseErrorAction, setParseOptions, setPessimisticSplitting, setReadBuffer, setReadOnClient, setRecordWarningThreshold, setSelectedFields, setSelectedFields, setSource, setSource, setSource, setSplitOptions, setUseMetadata

Methods inherited from class com.pervasive.datarush.operators.AbstractLogicalOperator

disableParallelism, getInputPorts, getOutputPorts, newInput, newInput, newOutput, newRecordInput, newRecordInput, newRecordOutput, notifyError

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.pervasive.datarush.operators.LogicalOperator

disableParallelism, getInputPorts, getOutputPorts

Constructor Details

ReadORC

public ReadORC()

Reads an empty source with default settings. The source must be set before execution or an error will be raised.

See Also:

• AbstractReader.setSource(ByteSource)

ReadORC

public ReadORC(String pattern)

Reads all paths matching the specified pattern using default options. Any matching path which is a directory is replaced with all files in the directory; this expansion is not recursive.

Parameters:

pattern - a path-matching pattern

See Also:

• FileClient.matchPaths(String)

ReadORC

public ReadORC(Path path)

Reads the file specified by the path. If the path refers to a a directory, all files in the directory are read; this read is not recursive into sub-directories.

Parameters:

path - the path to read

ReadORC

public ReadORC(ByteSource source)

Reads the specified data source using default options.

Parameters:

source - the data source to read

Method Details

computeFormat

protected DataFormat computeFormat(CompositionContext ctx)

Description copied from class: AbstractReader

Determines the data format for the source. The returned format is used during composition to construct a ReadSource operator. If an implementation supports schema discovery, it must be performed in this method.

Specified by:

computeFormat in class AbstractReader

Parameters:

ctx - the composition context for the current invocation of AbstractReader.compose(CompositionContext)

Returns:

the source format to use

discoverMetadata

public ORCMetadata discoverMetadata(FileClient client)

Gets the metadata for the currently configured data source.

Parameters:

client - the file client

Returns:

the metadata of the source