public class WriteORC extends AbstractWriter
Modifier and Type | Field and Description |
---|---|
static int |
MIN_ROW_INDEX_STRIDE |
input, options
Constructor and Description |
---|
WriteORC()
Writes an ORC file.
|
WriteORC(String pattern)
Writes an ORC file to the specified location.
|
Modifier and Type | Method and Description |
---|---|
protected DataFormat |
computeFormat(CompositionContext ctx)
Determines the data format for the target.
|
Boolean |
getBlockPadding() |
int |
getBufferSize() |
com.actian.dataflow.hive.shims.ORCCompression |
getCompression() |
Integer |
getRowIndexStride() |
long |
getStripeSize() |
com.actian.dataflow.hive.shims.ORCVersion |
getVersion() |
void |
setBlockPadding(boolean blockPadding)
Sets whether the HDFS blocks are padded to prevent stripes from
straddling blocks.
|
void |
setBufferSize(int bufferSize)
The size of the memory buffers used for compressing and storing the
stripe in memory.
|
void |
setCompression(com.actian.dataflow.hive.shims.ORCCompression compression)
Sets the compression mode to use within the ORC file.
|
void |
setMode(WriteMode mode)
Sets how the writer should handle an existing
target.
|
void |
setRowIndexStride(int rowIndexStride)
Set the distance between entries in the row index.
|
void |
setStripeSize(long stripeSize)
Set the stripe size for the file.
|
void |
setVersion(com.actian.dataflow.hive.shims.ORCVersion version)
Sets the version of the file that will be written.
|
compose, getFormatOptions, getInput, getMode, getSaveMetadata, getTarget, getWriteBuffer, getWriteOnClient, getWriteSingleSink, isIgnoreSortOrder, setFormatOptions, setIgnoreSortOrder, setSaveMetadata, setTarget, setTarget, setTarget, setWriteBuffer, setWriteOnClient, setWriteSingleSink
disableParallelism, getInputPorts, getOutputPorts, newInput, newInput, newOutput, newRecordInput, newRecordInput, newRecordOutput, notifyError
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
disableParallelism, getInputPorts, getOutputPorts
public static final int MIN_ROW_INDEX_STRIDE
public WriteORC()
public WriteORC(String pattern)
protected DataFormat computeFormat(CompositionContext ctx)
AbstractWriter
WriteSink
operator. If an
implementation supports schema discovery, it must be
performed in this method.computeFormat
in class AbstractWriter
ctx
- the composition context for the current invocation
of AbstractWriter.compose(CompositionContext)
public void setMode(WriteMode mode)
setMode
in class AbstractWriter
mode
- the behavior to use for existing filespublic com.actian.dataflow.hive.shims.ORCCompression getCompression()
public void setCompression(com.actian.dataflow.hive.shims.ORCCompression compression)
compression
- The compression modepublic long getStripeSize()
public void setStripeSize(long stripeSize)
public Integer getRowIndexStride()
public void setRowIndexStride(int rowIndexStride)
public int getBufferSize()
public void setBufferSize(int bufferSize)
public Boolean getBlockPadding()
public void setBlockPadding(boolean blockPadding)
public com.actian.dataflow.hive.shims.ORCVersion getVersion()
public void setVersion(com.actian.dataflow.hive.shims.ORCVersion version)
Copyright © 2024 Actian Corporation. All rights reserved.