Uses of Class
com.pervasive.datarush.ports.record.DataDistribution
-
Packages that use DataDistribution Package Description com.pervasive.datarush.analytics.r com.pervasive.datarush.operators.assertion Provides operators for making assertions on flows and files.com.pervasive.datarush.operators.io Provides base file I/O components including encoders and decoders.com.pervasive.datarush.operators.partition Provides operators for partitioning and unpartitioning flows of data.com.pervasive.datarush.ports.record Provides implementations of port objects related to the flow of record sets between operators. -
-
Uses of DataDistribution in com.pervasive.datarush.analytics.r
Methods in com.pervasive.datarush.analytics.r that return DataDistribution Modifier and Type Method Description DataDistribution
RunRScript. getRequiredDataDistribution()
Get the value set for the required data distribution of the input port of this operator.Methods in com.pervasive.datarush.analytics.r with parameters of type DataDistribution Modifier and Type Method Description void
RunRScript. setRequiredDataDistribution(DataDistribution dataDistribution)
Set the data distribution requirements for the input port of this operator. -
Uses of DataDistribution in com.pervasive.datarush.operators.assertion
Methods in com.pervasive.datarush.operators.assertion that return DataDistribution Modifier and Type Method Description DataDistribution
AssertMetadata. getDataDistribution()
Get the DataDistribution to assert.Methods in com.pervasive.datarush.operators.assertion with parameters of type DataDistribution Modifier and Type Method Description void
AssertMetadata. setDataDistribution(DataDistribution dataDistribution)
Set the DataDistribution to assert. -
Uses of DataDistribution in com.pervasive.datarush.operators.io
Methods in com.pervasive.datarush.operators.io that return DataDistribution Modifier and Type Method Description DataDistribution
FileMetadata. getDataDistribution()
Returns the data partitioning of the file.Constructors in com.pervasive.datarush.operators.io with parameters of type DataDistribution Constructor Description FileMetadata(RecordTokenType type, DataOrdering dataOrdering, DataDistribution dataDistribution)
Create a FileMetadata of the given type, ordering, distribution, and parallelism. -
Uses of DataDistribution in com.pervasive.datarush.operators.partition
Methods in com.pervasive.datarush.operators.partition that return DataDistribution Modifier and Type Method Description DataDistribution
PartitionHint. getPartitioning()
Gets the data distribution of the output.Methods in com.pervasive.datarush.operators.partition with parameters of type DataDistribution Modifier and Type Method Description void
PartitionHint. setPartitioning(DataDistribution partitioning)
Sets the data distribution of the output.Constructors in com.pervasive.datarush.operators.partition with parameters of type DataDistribution Constructor Description PartitionHint(DataDistribution partitioning)
Forces a partitioning into parallel streams of data guaranteeing the specified distribution. -
Uses of DataDistribution in com.pervasive.datarush.ports.record
Subclasses of DataDistribution in com.pervasive.datarush.ports.record Modifier and Type Class Description class
BalancedDistribution
Used to redistribute the data in a roughly balanced fashion.class
DynamicRangeDataDistribution
A distribution where data is range-partitioned by a selected array of keys.class
FullDataDistribution
An operator may set this as theirrequiredDataDistribution
in order to indicate that the data needs to be sent to all nodes in the cluster (or all threads in the case of pseudo-distributed operation).class
KeyDrivenDataDistribution
DataDistribution based on a set of keys from the input data.class
PartialDataDistribution
Base class for all distributions that represent a partitioning of the data.class
PartialDynamicDataDistribution
Base class for all distributions whose partitioning parameters are based on the data.class
PartialStaticDataDistribution
Base class for all distributions whose partitioning parameters are specified statically.class
UnspecifiedPartialDistribution
The default data distribution; if unspecified an operator will receive data in the same distribution as the upstream operator.Methods in com.pervasive.datarush.ports.record that return DataDistribution Modifier and Type Method Description DataDistribution
RecordPort. getCombinedDataDistribution(MetadataContext ctx)
Gets the required data distribution of this portDataDistribution
RecordMetadata. getDataDistribution()
Returns the data partitioning of the record port.DataDistribution
RecordPort. getRequiredDataDistribution(MetadataContext ctx)
Gets the required data distribution of this portDataDistribution
RecordPort. getSourceDataDistribution(MetadataContext ctx)
Returns source data distribution associated with this input port.abstract DataDistribution
DataDistribution. remap(FieldRemapping mapping)
Applies the given field remapping to this mapping, changing names as required.Methods in com.pervasive.datarush.ports.record with parameters of type DataDistribution Modifier and Type Method Description RecordMetadata
RecordMetadata. distributed(DataDistribution dataDistribution)
Returns a new RecordMetadata, equivalent to this, but with dataDistribution set to the specified value.RecordMetadataTest.RecordInputDefinition
RecordMetadataTest.RecordInputDefinition. distributed(DataDistribution distribution)
static KeyDrivenDataDistribution
MetadataUtil. negotiate(DataDistribution distribution, String... keys)
Negotiates the required data distribution with the specified distribution using the given grouping fields.void
RecordPort. setOutputDataDistribution(MetadataCalculationContext ctx, DataDistribution distribution)
Sets the data partitioning associated with the given record port.void
RecordPort. setRequiredDataDistribution(MetadataCalculationContext ctx, DataDistribution distribution)
Sets the required data distribution of this input port.Constructors in com.pervasive.datarush.ports.record with parameters of type DataDistribution Constructor Description RecordMetadata(RecordTokenType type, DataOrdering dataOrdering, DataDistribution dataDistribution)
Create a RecordMetadata of the given type, ordering, and distribution.
-