Module datarush.library

Package com.pervasive.datarush.ports.record

Provides implementations of port objects related to the flow of record sets between operators. Record sets are assumed to be too large to fit into memory all at once and are therefore handled in a streaming fashion. Data is accessed one record at a time, using physical ports which are created at runtime for this purpose.

Interface Summary

Interface	Description
PartitioningFunction	Represents a pluggable partitioning function; for use by operators that require custom partitioning
PartitioningFunction.Evaluator	Computes partition assignments for each row if input
PartitioningFunctionContext	Contextual information for PartitioningFunction's.
RecordMetadataTest.InputDefinition

Class Summary

Class	Description
AliasSet	An alias set consists of a set of name aliases and optionally a token order.
BalancedDistribution	Used to redistribute the data in a roughly balanced fashion.
DataDistribution	DataDistribution is the component of RecordMetadata that describes how the data is distributed.
DataOrdering	DataOrdering is the component of RecordMetadata that describes how the data is ordered.
DatasetOptions	Can be used to provide tuning parameters that control how iterative operators stage their data.
DynamicRangeDataDistribution	A distribution where data is range-partitioned by a selected array of keys.
ExternalRecordSink	Defines an external sink of record data.
ExternalRecordSource	Defines an external source of record data.
FullDataDistribution	An operator may set this as their requiredDataDistribution in order to indicate that the data needs to be sent to all nodes in the cluster (or all threads in the case of pseudo-distributed operation).
HashPartitioningFunction	A default hash partitioning function
KeyDrivenDataDistribution	DataDistribution based on a set of keys from the input data.
MetadataUtil	Provides utility methods for working with port metadata.
PartialDataDistribution	Base class for all distributions that represent a partitioning of the data.
PartialDynamicDataDistribution	Base class for all distributions whose partitioning parameters are based on the data.
PartialStaticDataDistribution	Base class for all distributions whose partitioning parameters are specified statically.
RangePartitioningFunction	A partitioning function that partitions records of data based on specified ranges.
RecordMetadata	The metadata associated with record ports.
RecordMetadataTest
RecordMetadataTest.Expectation
RecordMetadataTest.GenericInputDefinition
RecordMetadataTest.OutputExpectation
RecordMetadataTest.RecordInputDefinition
RecordMetadataTest.RequiredExpectation
RecordPort	Defines a logical record port.
RecordPortOptions	Provides a way for iterative operators to select a filtered view of one of their input ports.
UnspecifiedPartialDistribution	The default data distribution; if unspecified an operator will receive data in the same distribution as the upstream operator.