Uses of Class
com.pervasive.datarush.ports.record.DataDistribution
-
Packages that use DataDistribution Package Description com.pervasive.datarush.analytics.r com.pervasive.datarush.operators.assertion Provides operators for making assertions on flows and files.com.pervasive.datarush.operators.io Provides base file I/O components including encoders and decoders.com.pervasive.datarush.operators.partition Provides operators for partitioning and unpartitioning flows of data.com.pervasive.datarush.ports.record Provides implementations of port objects related to the flow of record sets between operators. -
-
Uses of DataDistribution in com.pervasive.datarush.analytics.r
Methods in com.pervasive.datarush.analytics.r that return DataDistribution Modifier and Type Method Description DataDistributionRunRScript. getRequiredDataDistribution()Get the value set for the required data distribution of the input port of this operator.Methods in com.pervasive.datarush.analytics.r with parameters of type DataDistribution Modifier and Type Method Description voidRunRScript. setRequiredDataDistribution(DataDistribution dataDistribution)Set the data distribution requirements for the input port of this operator. -
Uses of DataDistribution in com.pervasive.datarush.operators.assertion
Methods in com.pervasive.datarush.operators.assertion that return DataDistribution Modifier and Type Method Description DataDistributionAssertMetadata. getDataDistribution()Get the DataDistribution to assert.Methods in com.pervasive.datarush.operators.assertion with parameters of type DataDistribution Modifier and Type Method Description voidAssertMetadata. setDataDistribution(DataDistribution dataDistribution)Set the DataDistribution to assert. -
Uses of DataDistribution in com.pervasive.datarush.operators.io
Methods in com.pervasive.datarush.operators.io that return DataDistribution Modifier and Type Method Description DataDistributionFileMetadata. getDataDistribution()Returns the data partitioning of the file.Constructors in com.pervasive.datarush.operators.io with parameters of type DataDistribution Constructor Description FileMetadata(RecordTokenType type, DataOrdering dataOrdering, DataDistribution dataDistribution)Create a FileMetadata of the given type, ordering, distribution, and parallelism. -
Uses of DataDistribution in com.pervasive.datarush.operators.partition
Methods in com.pervasive.datarush.operators.partition that return DataDistribution Modifier and Type Method Description DataDistributionPartitionHint. getPartitioning()Gets the data distribution of the output.Methods in com.pervasive.datarush.operators.partition with parameters of type DataDistribution Modifier and Type Method Description voidPartitionHint. setPartitioning(DataDistribution partitioning)Sets the data distribution of the output.Constructors in com.pervasive.datarush.operators.partition with parameters of type DataDistribution Constructor Description PartitionHint(DataDistribution partitioning)Forces a partitioning into parallel streams of data guaranteeing the specified distribution. -
Uses of DataDistribution in com.pervasive.datarush.ports.record
Subclasses of DataDistribution in com.pervasive.datarush.ports.record Modifier and Type Class Description classBalancedDistributionUsed to redistribute the data in a roughly balanced fashion.classDynamicRangeDataDistributionA distribution where data is range-partitioned by a selected array of keys.classFullDataDistributionAn operator may set this as theirrequiredDataDistributionin order to indicate that the data needs to be sent to all nodes in the cluster (or all threads in the case of pseudo-distributed operation).classKeyDrivenDataDistributionDataDistribution based on a set of keys from the input data.classPartialDataDistributionBase class for all distributions that represent a partitioning of the data.classPartialDynamicDataDistributionBase class for all distributions whose partitioning parameters are based on the data.classPartialStaticDataDistributionBase class for all distributions whose partitioning parameters are specified statically.classUnspecifiedPartialDistributionThe default data distribution; if unspecified an operator will receive data in the same distribution as the upstream operator.Methods in com.pervasive.datarush.ports.record that return DataDistribution Modifier and Type Method Description DataDistributionRecordPort. getCombinedDataDistribution(MetadataContext ctx)Gets the required data distribution of this portDataDistributionRecordMetadata. getDataDistribution()Returns the data partitioning of the record port.DataDistributionRecordPort. getRequiredDataDistribution(MetadataContext ctx)Gets the required data distribution of this portDataDistributionRecordPort. getSourceDataDistribution(MetadataContext ctx)Returns source data distribution associated with this input port.abstract DataDistributionDataDistribution. remap(FieldRemapping mapping)Applies the given field remapping to this mapping, changing names as required.Methods in com.pervasive.datarush.ports.record with parameters of type DataDistribution Modifier and Type Method Description RecordMetadataRecordMetadata. distributed(DataDistribution dataDistribution)Returns a new RecordMetadata, equivalent to this, but with dataDistribution set to the specified value.RecordMetadataTest.RecordInputDefinitionRecordMetadataTest.RecordInputDefinition. distributed(DataDistribution distribution)static KeyDrivenDataDistributionMetadataUtil. negotiate(DataDistribution distribution, String... keys)Negotiates the required data distribution with the specified distribution using the given grouping fields.voidRecordPort. setOutputDataDistribution(MetadataCalculationContext ctx, DataDistribution distribution)Sets the data partitioning associated with the given record port.voidRecordPort. setRequiredDataDistribution(MetadataCalculationContext ctx, DataDistribution distribution)Sets the required data distribution of this input port.Constructors in com.pervasive.datarush.ports.record with parameters of type DataDistribution Constructor Description RecordMetadata(RecordTokenType type, DataOrdering dataOrdering, DataDistribution dataDistribution)Create a RecordMetadata of the given type, ordering, and distribution.
-