Package | Description |
---|---|
com.pervasive.datarush.analytics.r | |
com.pervasive.datarush.operators.assertion |
Provides operators for making assertions on flows and files.
|
com.pervasive.datarush.operators.io |
Provides base file I/O components including encoders and decoders.
|
com.pervasive.datarush.operators.partition |
Provides operators for partitioning and unpartitioning flows of data.
|
com.pervasive.datarush.ports.record |
Provides implementations of port objects related to the flow of record sets
between operators.
|
Modifier and Type | Method and Description |
---|---|
DataDistribution |
RunRScript.getRequiredDataDistribution()
Get the value set for the required data distribution of the input port of this
operator.
|
Modifier and Type | Method and Description |
---|---|
void |
RunRScript.setRequiredDataDistribution(DataDistribution dataDistribution)
Set the data distribution requirements for the input port of this operator.
|
Modifier and Type | Method and Description |
---|---|
DataDistribution |
AssertMetadata.getDataDistribution()
Get the DataDistribution to assert.
|
Modifier and Type | Method and Description |
---|---|
void |
AssertMetadata.setDataDistribution(DataDistribution dataDistribution)
Set the DataDistribution to assert.
|
Modifier and Type | Method and Description |
---|---|
DataDistribution |
FileMetadata.getDataDistribution()
Returns the data partitioning of the file.
|
Constructor and Description |
---|
FileMetadata(RecordTokenType type,
DataOrdering dataOrdering,
DataDistribution dataDistribution)
Create a FileMetadata of the given type, ordering, distribution, and parallelism.
|
Modifier and Type | Method and Description |
---|---|
DataDistribution |
PartitionHint.getPartitioning()
Gets the data distribution of the output.
|
Modifier and Type | Method and Description |
---|---|
void |
PartitionHint.setPartitioning(DataDistribution partitioning)
Sets the data distribution of the output.
|
Constructor and Description |
---|
PartitionHint(DataDistribution partitioning)
Forces a partitioning into parallel streams of data
guaranteeing the specified distribution.
|
Modifier and Type | Class and Description |
---|---|
class |
BalancedDistribution
Used to redistribute the data in a roughly balanced fashion.
|
class |
DynamicRangeDataDistribution
A distribution where data is range-partitioned by a selected array of keys.
|
class |
FullDataDistribution
An operator may set this as their
requiredDataDistribution
in order to indicate that the data needs to be sent to all nodes in the cluster (or all
threads in the case of pseudo-distributed operation). |
class |
KeyDrivenDataDistribution
DataDistribution based on a set of keys from the input data.
|
class |
PartialDataDistribution
Base class for all distributions that represent a partitioning of the data.
|
class |
PartialDynamicDataDistribution
Base class for all distributions whose partitioning parameters are based on the data.
|
class |
PartialStaticDataDistribution
Base class for all distributions whose partitioning parameters are specified statically.
|
class |
UnspecifiedPartialDistribution
The default data distribution; if unspecified an operator will receive data in the same
distribution as the upstream operator.
|
Modifier and Type | Method and Description |
---|---|
DataDistribution |
RecordPort.getCombinedDataDistribution(MetadataContext ctx)
Gets the required data distribution of this port
|
DataDistribution |
RecordMetadata.getDataDistribution()
Returns the data partitioning of the record port.
|
DataDistribution |
RecordPort.getRequiredDataDistribution(MetadataContext ctx)
Gets the required data distribution of this port
|
DataDistribution |
RecordPort.getSourceDataDistribution(MetadataContext ctx)
Returns source data distribution associated with this input port.
|
abstract DataDistribution |
DataDistribution.remap(FieldRemapping mapping)
Applies the given field remapping to this mapping, changing names as required.
|
Modifier and Type | Method and Description |
---|---|
RecordMetadata |
RecordMetadata.distributed(DataDistribution dataDistribution)
Returns a new RecordMetadata, equivalent to this, but
with dataDistribution set to the specified value.
|
static KeyDrivenDataDistribution |
MetadataUtil.negotiate(DataDistribution distribution,
String... keys)
Negotiates the required data distribution with the specified distribution
using the given grouping fields.
|
void |
RecordPort.setOutputDataDistribution(MetadataCalculationContext ctx,
DataDistribution distribution)
Sets the data partitioning associated with the given record port.
|
void |
RecordPort.setRequiredDataDistribution(MetadataCalculationContext ctx,
DataDistribution distribution)
Sets the required data distribution of this input port.
|
Constructor and Description |
---|
RecordMetadata(RecordTokenType type,
DataOrdering dataOrdering,
DataDistribution dataDistribution)
Create a RecordMetadata of the given type, ordering, and distribution.
|
Copyright © 2020 Actian Corporation. All rights reserved.