Uses of Class
com.pervasive.datarush.ports.record.DataDistribution
Packages that use DataDistribution
Package
Description
Provides operators for making assertions on flows and files.
Provides base file I/O components including encoders and decoders.
Provides operators for partitioning and unpartitioning flows of data.
Provides implementations of port objects related to the flow of record sets
between operators.
-
Uses of DataDistribution in com.pervasive.datarush.analytics.r
Methods in com.pervasive.datarush.analytics.r that return DataDistributionModifier and TypeMethodDescriptionRunRScript.getRequiredDataDistribution()Get the value set for the required data distribution of the input port of this operator.Methods in com.pervasive.datarush.analytics.r with parameters of type DataDistributionModifier and TypeMethodDescriptionvoidRunRScript.setRequiredDataDistribution(DataDistribution dataDistribution) Set the data distribution requirements for the input port of this operator. -
Uses of DataDistribution in com.pervasive.datarush.operators.assertion
Methods in com.pervasive.datarush.operators.assertion that return DataDistributionModifier and TypeMethodDescriptionAssertMetadata.getDataDistribution()Get the DataDistribution to assert.Methods in com.pervasive.datarush.operators.assertion with parameters of type DataDistributionModifier and TypeMethodDescriptionvoidAssertMetadata.setDataDistribution(DataDistribution dataDistribution) Set the DataDistribution to assert. -
Uses of DataDistribution in com.pervasive.datarush.operators.io
Methods in com.pervasive.datarush.operators.io that return DataDistributionModifier and TypeMethodDescriptionFileMetadata.getDataDistribution()Returns the data partitioning of the file.Constructors in com.pervasive.datarush.operators.io with parameters of type DataDistributionModifierConstructorDescriptionFileMetadata(RecordTokenType type, DataOrdering dataOrdering, DataDistribution dataDistribution) Create a FileMetadata of the given type, ordering, distribution, and parallelism. -
Uses of DataDistribution in com.pervasive.datarush.operators.partition
Methods in com.pervasive.datarush.operators.partition that return DataDistributionModifier and TypeMethodDescriptionPartitionHint.getPartitioning()Gets the data distribution of the output.Methods in com.pervasive.datarush.operators.partition with parameters of type DataDistributionModifier and TypeMethodDescriptionvoidPartitionHint.setPartitioning(DataDistribution partitioning) Sets the data distribution of the output.Constructors in com.pervasive.datarush.operators.partition with parameters of type DataDistributionModifierConstructorDescriptionPartitionHint(DataDistribution partitioning) Forces a partitioning into parallel streams of data guaranteeing the specified distribution. -
Uses of DataDistribution in com.pervasive.datarush.ports.record
Subclasses of DataDistribution in com.pervasive.datarush.ports.recordModifier and TypeClassDescriptionfinal classUsed to redistribute the data in a roughly balanced fashion.final classA distribution where data is range-partitioned by a selected array of keys.final classAn operator may set this as theirrequiredDataDistributionin order to indicate that the data needs to be sent to all nodes in the cluster (or all threads in the case of pseudo-distributed operation).final classDataDistribution based on a set of keys from the input data.classBase class for all distributions that represent a partitioning of the data.classBase class for all distributions whose partitioning parameters are based on the data.classBase class for all distributions whose partitioning parameters are specified statically.final classThe default data distribution; if unspecified an operator will receive data in the same distribution as the upstream operator.Methods in com.pervasive.datarush.ports.record that return DataDistributionModifier and TypeMethodDescriptionRecordPort.getCombinedDataDistribution(MetadataContext ctx) Gets the required data distribution of this portRecordMetadata.getDataDistribution()Returns the data partitioning of the record port.RecordPort.getRequiredDataDistribution(MetadataContext ctx) Gets the required data distribution of this portRecordPort.getSourceDataDistribution(MetadataContext ctx) Returns source data distribution associated with this input port.abstract DataDistributionDataDistribution.remap(FieldRemapping mapping) Applies the given field remapping to this mapping, changing names as required.Methods in com.pervasive.datarush.ports.record with parameters of type DataDistributionModifier and TypeMethodDescriptionRecordMetadata.distributed(DataDistribution dataDistribution) Returns a new RecordMetadata, equivalent to this, but with dataDistribution set to the specified value.RecordMetadataTest.RecordInputDefinition.distributed(DataDistribution distribution) static KeyDrivenDataDistributionMetadataUtil.negotiate(DataDistribution distribution, String... keys) Negotiates the required data distribution with the specified distribution using the given grouping fields.voidRecordPort.setOutputDataDistribution(MetadataCalculationContext ctx, DataDistribution distribution) Sets the data partitioning associated with the given record port.voidRecordPort.setRequiredDataDistribution(MetadataCalculationContext ctx, DataDistribution distribution) Sets the required data distribution of this input port.Constructors in com.pervasive.datarush.ports.record with parameters of type DataDistributionModifierConstructorDescriptionRecordMetadata(RecordTokenType type, DataOrdering dataOrdering, DataDistribution dataDistribution) Create a RecordMetadata of the given type, ordering, and distribution.