Uses of Interface
com.pervasive.datarush.types.ScalarTokenType

Packages that use ScalarTokenType

Package	Description
com.actian.dataflow.operators.io.orc
com.pervasive.datarush.analytics.cleansing	Provides operators related to data cleansing.
com.pervasive.datarush.analytics.knn	Provides an implementation of the KNN algorithm using DataRush's sparse data API.
com.pervasive.datarush.analytics.util	Provides some (internal) utility classes for Analytics.
com.pervasive.datarush.coercion	Provides classes for dynamic coercion of data structures (for example, arrays and maps) to complex Java objects.
com.pervasive.datarush.functions	Provides classes and interfaces related to defining functions on records.
com.pervasive.datarush.operators.group	Provides data aggregation components.
com.pervasive.datarush.operators.io.avro	Provides operators for reading and writing files in Avro format.
com.pervasive.datarush.operators.io.staging	Provides operators for reading and writing DataRush staging datasets.
com.pervasive.datarush.operators.record	Provides operators for manipulating record structure.
com.pervasive.datarush.operators.source	Provides operators for generating data tokens in various ways.
com.pervasive.datarush.ports.physical	Provides classes and interfaces for accessing and producing the data flowing between operators in a dataflow graph.
com.pervasive.datarush.schema	Provides an object model for capturing schema information used primarily by the textfile package.
com.pervasive.datarush.sequences	Provides classes and interfaces related to sequences of tokens.
com.pervasive.datarush.sequences.scalar	Provides implementations of sequences of scalar token values.
com.pervasive.datarush.tokens	Provides classes and utilities for working with data tokens.
com.pervasive.datarush.tokens.record	Provides implementations of and utilities for record valued tokens.
com.pervasive.datarush.tokens.scalar	Provides implementations of and utilities for scalar valued tokens.
com.pervasive.datarush.types	Provides classes and interfaces for the description of token data types.
com.pervasive.datarush.util	Provides common utilities

Uses of ScalarTokenType in com.actian.dataflow.operators.io.orc

Methods in com.actian.dataflow.operators.io.orc with parameters of type ScalarTokenType

Modifier and Type	Method and Description
boolean	ORCFormat.isSupportedWriterType(ScalarTokenType type)

Uses of ScalarTokenType in com.pervasive.datarush.analytics.cleansing

Methods in com.pervasive.datarush.analytics.cleansing that return ScalarTokenType

Modifier and Type	Method and Description
ScalarTokenType	ReplaceSpecification.getFieldType() Get the field type.

Methods in com.pervasive.datarush.analytics.cleansing with parameters of type ScalarTokenType

Modifier and Type	Method and Description
static ReplaceSpecification	ReplaceSpecification.constant(ScalarTokenType type, String value) Create a replacement specification with the ReplaceSpecification.Action.REPLACE_CONSTANT action for fields with the specified type.
static ReplaceSpecification	ReplaceSpecification.freq(ScalarTokenType type) Create a replacement specification with the ReplaceSpecification.Action.REPLACE_MOST_FREQ action for fields with the specified type.
boolean	ReplaceSpecification.Action.isTypeSupported(ScalarTokenType type) Returns whether this action supports the given field type
static ReplaceSpecification	ReplaceSpecification.max(ScalarTokenType type) Create a replacement specification with the ReplaceSpecification.Action.REPLACE_MAX action for fields with the specified type.
static ReplaceSpecification	ReplaceSpecification.mean(ScalarTokenType type) Create a replacement specification with the ReplaceSpecification.Action.REPLACE_MEAN action for fields with the specified type.
static ReplaceSpecification	ReplaceSpecification.median(ScalarTokenType type) Create a replacement specification with the ReplaceSpecification.Action.REPLACE_MEDIAN action for fields with the specified type.
static ReplaceSpecification	ReplaceSpecification.min(ScalarTokenType type) Create a replacement specification with the ReplaceSpecification.Action.REPLACE_MIN action for fields with the specified type.
static ReplaceSpecification	ReplaceSpecification.none(ScalarTokenType type) Create a replacement specification with the ReplaceSpecification.Action.NONE action for fields with the specified type.
void	ReplaceSpecification.setFieldType(ScalarTokenType fieldType) Set the field (token) type.
static ReplaceSpecification	ReplaceSpecification.skip(ScalarTokenType type) Create a replacement specification with the ReplaceSpecification.Action.SKIP_RECORD action for fields with the specified type.

Uses of ScalarTokenType in com.pervasive.datarush.analytics.knn

Methods in com.pervasive.datarush.analytics.knn with parameters of type ScalarTokenType

Modifier and Type	Method and Description
boolean	VotingClassification.isValidTargetType(ScalarTokenType type)
abstract boolean	ClassificationScheme.isValidTargetType(ScalarTokenType type) Indicates whether the classification method is valid for the specified type.

Uses of ScalarTokenType in com.pervasive.datarush.analytics.util

Methods in com.pervasive.datarush.analytics.util that return ScalarTokenType

Modifier and Type	Method and Description
ScalarTokenType	DynamicEnumerationType.getTokenType()

Uses of ScalarTokenType in com.pervasive.datarush.coercion

Fields in com.pervasive.datarush.coercion declared as ScalarTokenType

Modifier and Type	Field and Description
static ScalarTokenType	ScalarTypes.BINARY
static ScalarTokenType	ScalarTypes.BOOLEAN
static ScalarTokenType	ScalarTypes.CHAR
static ScalarTokenType	ScalarTypes.DATE
static ScalarTokenType	ScalarTypes.DOUBLE
static ScalarTokenType	ScalarTypes.FLOAT
static ScalarTokenType	ScalarTypes.INT
static ScalarTokenType	ScalarTypes.LONG
static ScalarTokenType	ScalarTypes.NUMERIC
static ScalarTokenType	ScalarTypes.STRING
static ScalarTokenType	ScalarTypes.TIMESTAMP

Uses of ScalarTokenType in com.pervasive.datarush.functions

Methods in com.pervasive.datarush.functions that return ScalarTokenType

Modifier and Type	Method and Description
ScalarTokenType	WidestInputTyper.computeResultType(FunctionContext ctx)
ScalarTokenType	FunctionTyper.computeResultType(FunctionContext ctx) Calculates the result type for the function given the provided context.
ScalarTokenType	FixedType.computeResultType(FunctionContext ctx)
ScalarTokenType	WidestInputTyper.computeUpperBound(FunctionContext ctx)
ScalarTokenType	FunctionTyper.computeUpperBound(FunctionContext ctx) Calculates the upper bound for the function given the provided context.
ScalarTokenType	FixedType.computeUpperBound(FunctionContext ctx)
ScalarTokenType	FunctionContext.getArgumentType(int i) Gets the datatype of the specified argument.
protected ScalarTokenType	ResultMappedFactory.getDispatchType(ScalarSettable result, Object[] arguments)
protected abstract ScalarTokenType	MappedEvaluatorFactory.getDispatchType(ScalarSettable result, Object[] arguments) Determines the type to use to select the evaluator.
protected ScalarTokenType	InputMappedFactory.getDispatchType(ScalarSettable result, Object[] arguments)
ScalarTokenType	InvalidOperandTypeException.getRequiredType() Gets the type requirement which failed to be satisfied.
ScalarTokenType	ScalarValuedFunction.getUpperBound() Gets the upper bound on the output type of the function.
ScalarTokenType	FieldReference.getUpperBound()
ScalarTokenType	ConstantReference.getUpperBound()
ScalarTokenType	ScalarValuedFunction.validateInputType(RecordTokenType inputType) Calculates the actual output type of the function given the specified input type.
ScalarTokenType	FieldReference.validateInputType(RecordTokenType inputType)
ScalarTokenType	ConstantReference.validateInputType(RecordTokenType inputType)
static ScalarTokenType	FunctionUtil.widestInputType(FunctionContext ctx) Returns the widest input type for all ScalarValuedFunction arguments in the context.
static ScalarTokenType	FunctionUtil.widestInputType(FunctionContext ctx, int... indices) Returns the widest input type for all specified ScalarValuedFunction arguments in the context.

Methods in com.pervasive.datarush.functions with parameters of type ScalarTokenType

Modifier and Type	Method and Description
void	InvalidOperandTypeException.addOperand(ScalarValuedFunction operand, ScalarTokenType operandType) Adds an additional subexpression and its type to the error.
static ScalarFunctionDescriptor.SubexpressionBound	ScalarFunctionDescriptor.arg(ScalarValuedFunction subexpr, ScalarTokenType type) Declares the given subexpression has the specified type bound.
ScalarValued	EvaluationContext.constructSubexpressionEvaluation(EvaluatorFactory factory, List<Object> arguments, ScalarTokenType resultType) Creates an evaluation of a subexpression which can be used as input to the evaluator of the expression containing it.
static ScalarValuedFunction	ScalarFunctionDescriptor.define(String name, ScalarTokenType resultType, Class<? extends FunctionEvaluator> evaluator, Object... args) Defines an instance of a function returning a result of the specified type and using an evaluator of the given class.
static ScalarValuedFunction	ScalarFunctionDescriptor.define(String name, ScalarTokenType resultType, EvaluatorFactory factory, Object... args) Defines an instance of a function returning a result of the specified type but needing to choose between possible evaluator implementations.
static MappedEvaluatorFactory.Mapping	MappedEvaluatorFactory.use(ScalarTokenType type, Class<? extends FunctionEvaluator> evaluator) Defines the evaluator class for a given type.
static ScalarFunctionDescriptor.SubexpressionBound	ScalarFunctionDescriptor.varargs(List<? extends ScalarValuedFunction> subexprs, ScalarTokenType type) Declares a variable number of arguments, all having the specified type bound.

Constructors in com.pervasive.datarush.functions with parameters of type ScalarTokenType

Constructor and Description
FixedType(ScalarTokenType type) Creates a typer which always returns the given type.
InvalidOperandTypeException(String reason, ScalarTokenType required) Declares an exception occurred for the specified reason.
InvalidOperandTypeException(String reason, ScalarTokenType required, ScalarValuedFunction operand, ScalarTokenType operandType) Declares an exception occurred for the specified reason, caused by the given subexpression yielding a result of the given type.
InvalidOperandTypeException(String reason, ScalarValuedFunction operand, ScalarTokenType operandType) Declares an exception occurred for the specified reason, caused by the given subexpression yielding a result of the given type.
WidestInputTyper(ScalarTokenType bound, int... indices) Defines a type using the specified inputs to determine the output type.

Uses of ScalarTokenType in com.pervasive.datarush.operators.group

Methods in com.pervasive.datarush.operators.group that return ScalarTokenType

Modifier and Type	Method and Description
ScalarTokenType[]	Aggregator.getInternalTypes() Returns the types of the internal counters of this aggregator
ScalarTokenType	Aggregator.getOutputType() Returns the output type of this aggregator.

Methods in com.pervasive.datarush.operators.group with parameters of type ScalarTokenType

Modifier and Type	Method and Description
Aggregator	AggregatorFactory.newAggregator(List<String> inputNames, ScalarTokenType[] inputs) Create a new aggregator for the given inputs.

Uses of ScalarTokenType in com.pervasive.datarush.operators.io.avro

Methods in com.pervasive.datarush.operators.io.avro with parameters of type ScalarTokenType

Modifier and Type	Method and Description
static boolean	AvroSchemaUtils.isWritable(ScalarTokenType type, org.apache.avro.Schema schema) Indicates whether the specified DataRush type can be encoded in the given schema.

Uses of ScalarTokenType in com.pervasive.datarush.operators.io.staging

Methods in com.pervasive.datarush.operators.io.staging with parameters of type ScalarTokenType

Modifier and Type	Method and Description
ScalarValuedIterator	DatasetIterator.newFieldIterator(ScalarTokenType type)
ScalarValuedIterator	DatasetIterator.newFieldIterator(ScalarTokenType type, String[] selectedFieldNames)

Uses of ScalarTokenType in com.pervasive.datarush.operators.record

Methods in com.pervasive.datarush.operators.record with parameters of type ScalarTokenType

Modifier and Type	Method and Description
static FieldDerivation	FieldDerivation.apply(ScalarTokenType fieldType, ScalarValuedFunction f, String variableName) Applies a function to each input field matching the specified type criteria.
static FieldDerivation	FieldDerivation.apply(ScalarTokenType fieldType, String expression, String variableName) Applies an expression to each input field matching the specified type criteria.

Uses of ScalarTokenType in com.pervasive.datarush.operators.source

Methods in com.pervasive.datarush.operators.source with parameters of type ScalarTokenType

Modifier and Type	Method and Description
static ScalarValuedFunction	Sequences.sequence(ScalarTokenType resultType) Creates a sequence function that increments the value with each invocation.
static ScalarValuedFunction	Sequences.sequence(ScalarTokenType resultType, BigDecimal startValue, BigDecimal stepSize) Creates a sequence function that increments the value with each invocation.

Uses of ScalarTokenType in com.pervasive.datarush.ports.physical

Methods in com.pervasive.datarush.ports.physical that return ScalarTokenType

Modifier and Type	Method and Description
ScalarTokenType	ScalarOutputField.getType()
ScalarTokenType	ScalarInputField.getType() Gets the type of tokens in the underlying flow.

Uses of ScalarTokenType in com.pervasive.datarush.schema

Methods in com.pervasive.datarush.schema that return ScalarTokenType

Modifier and Type	Method and Description
ScalarTokenType	TextDataType.getTokenType() Gets the token type used internally for the external type.
ScalarTokenType	PaddedTextType.getTokenType()

Methods in com.pervasive.datarush.schema with parameters of type ScalarTokenType

Modifier and Type	Method and Description
static TextDataType	TextTypes.getDefaultExternalType(ScalarTokenType type) Gets the default external type for the given token type.

Uses of ScalarTokenType in com.pervasive.datarush.sequences

Methods in com.pervasive.datarush.sequences with parameters of type ScalarTokenType

Modifier and Type	Method and Description
static MutableScalarTokenSequence	TokenSequences.allocateList(ScalarTokenType type, int initialCapacity) Creates a MutableTokenSequence for tokens of the specified scalar type.
static MutableScalarTokenSequence	TokenSequences.allocateList(ScalarTokenType type, int initialCapacity, DataRepresentation representation) Creates a MutableTokenSequence for tokens of the specified scalar type.

Uses of ScalarTokenType in com.pervasive.datarush.sequences.scalar

Methods in com.pervasive.datarush.sequences.scalar that return ScalarTokenType

Modifier and Type	Method and Description
ScalarTokenType	TimestampTokenList.getType()
ScalarTokenType	TimeTokenList.getType()
ScalarTokenType	SeekableScalarValuedIterator.getType()
ScalarTokenType	ScalarValuedIterator.getType()
ScalarTokenType	ScalarTokenSequence.getType() Gets the data type of the tokens in the sequence.
ScalarTokenType	NumericTokenList.getType()
ScalarTokenType	LongTokenList.getType()
ScalarTokenType	IntTokenList.getType()
ScalarTokenType	FloatTokenList.getType()
ScalarTokenType	DoubleTokenList.getType()
ScalarTokenType	DateTokenList.getType()
ScalarTokenType	CharTokenList.getType()
ScalarTokenType	BooleanTokenList.getType()
ScalarTokenType	BinaryTokenList.getType()

Uses of ScalarTokenType in com.pervasive.datarush.tokens

Methods in com.pervasive.datarush.tokens that return ScalarTokenType

Modifier and Type	Method and Description
static ScalarTokenType[]	TokenUtils.getTypes(ScalarValued[] values) Extracts the types of an array of scalar token values.

Methods in com.pervasive.datarush.tokens with parameters of type ScalarTokenType

Modifier and Type	Method and Description
static RecordTokenComparator	TokenComparators.getCompositeComparator(ScalarTokenType[] types, TokenOrder order) Creates a composite comparator appropriate for the given types ordered in the specified direction.
static RecordTokenComparator	TokenComparators.getCompositeComparator(ScalarTokenType[] types, TokenOrder[] order) Creates a composite comparator appropriate for the given types ordered in the specified direction for each field.
static ScalarRegister[]	TokenRegisters.getRegisters(ScalarTokenType[] types) Creates an array of ScalarRegister's for the given types.
static ScalarToken	TokenUtils.parse(ScalarTokenType type, String value) Parses the given string as a value of the specified type.

Uses of ScalarTokenType in com.pervasive.datarush.tokens.record

Methods in com.pervasive.datarush.tokens.record that return ScalarTokenType

Modifier and Type	Method and Description
ScalarTokenType	FieldIteratorProperties.getType() Returns the type of field iterator to select.

Methods in com.pervasive.datarush.tokens.record that return types with arguments of type ScalarTokenType

Modifier and Type	Method and Description
Map<ScalarTokenType,int[]>	RecordRegisterStorage.RecordInfo.fieldsByType()

Methods in com.pervasive.datarush.tokens.record with parameters of type ScalarTokenType

Modifier and Type	Method and Description
MutableScalarTokenSequence	RecordRegisterStorageImpl.group(ScalarTokenType type)
MutableScalarTokenSequence	RecordRegisterStorage.group(ScalarTokenType type)
ScalarValuedIterator	SparseRecordRegister.newFieldIterator(ScalarTokenType type)
ScalarValuedIterator	RecordValuedFilter.newFieldIterator(ScalarTokenType type)
ScalarValuedIterator	RecordValued.newFieldIterator(ScalarTokenType type) Create a new iterator for visiting the fields in this RecordValued object.
ScalarValuedIterator	RecordMap.RecordMapIterator.newFieldIterator(ScalarTokenType type)
ScalarValuedIterator	AbstractRecordValued.newFieldIterator(ScalarTokenType type)
ScalarValuedIterator	SparseRecordRegister.newFieldIterator(ScalarTokenType type, String[] selectedFieldNames)
ScalarValuedIterator	RecordValuedFilter.newFieldIterator(ScalarTokenType type, String[] selectedFieldNames)
ScalarValuedIterator	RecordValued.newFieldIterator(ScalarTokenType type, String[] selectedFieldNames) Create a new iterator for visiting the fields in this RecordValued object.
ScalarValuedIterator	RecordMap.RecordMapIterator.newFieldIterator(ScalarTokenType type, String[] selectedFieldNames)
ScalarValuedIterator	AbstractRecordValued.newFieldIterator(ScalarTokenType type, String[] selectedFieldNames)

Constructors in com.pervasive.datarush.tokens.record with parameters of type ScalarTokenType

Constructor and Description
FieldIteratorProperties(ScalarTokenType type) Creates a new FieldIteratorProperties, whose selected fields are those that exactly match the given type.
FieldIteratorProperties(ScalarTokenType type, String[] selectedFields) Creates a new FieldIteratorProperties, whose selected fields are those specified.
FieldIteratorProperties(ScalarTokenType type, String[] selectedFields, boolean sorted) Creates a new FieldIteratorProperties, whose selected fields are those specified.

Uses of ScalarTokenType in com.pervasive.datarush.tokens.scalar

Methods in com.pervasive.datarush.tokens.scalar that return ScalarTokenType

Modifier and Type	Method and Description
ScalarTokenType	TimestampTokenConverter.getType() Deprecated.
ScalarTokenType	ScalarValued.getType()
ScalarTokenType	NullToken.getType()
ScalarTokenType	DateTokenConverter.getType() Deprecated.

Uses of ScalarTokenType in com.pervasive.datarush.types

Classes in com.pervasive.datarush.types that implement ScalarTokenType

Modifier and Type	Class and Description
class	EnumTokenType Deprecated. Replace with string+domain
class	ObjectTokenType<O> A description of a scalar data type for a Java class.

Fields in com.pervasive.datarush.types declared as ScalarTokenType

Modifier and Type	Field and Description
static ScalarTokenType	TokenTypeConstant.BINARY A description of the binary token type.
static ScalarTokenType	TokenTypeConstant.BOOLEAN A description of the boolean token type.
static ScalarTokenType	TokenTypeConstant.CHAR A description of the character token type.
static ScalarTokenType	TokenTypeConstant.DATE A description of the date token type.
static ScalarTokenType	TokenTypeConstant.DOUBLE A description of the double token type.
static ScalarTokenType	TokenTypeConstant.FLOAT A description of the float token type.
static ScalarTokenType	TokenTypeConstant.INT A description of the integer token type.
static ScalarTokenType	TokenTypeConstant.LONG A description of the long token type.
static ScalarTokenType	TokenTypeConstant.NULL A description of the null token type.
static ScalarTokenType	TokenTypeConstant.NUMERIC A description of the numeric token type.
static ScalarTokenType	TokenTypeConstant.SCALAR An abstract type representing any scalar type.
static ScalarTokenType	TokenTypeConstant.STRING A description of the string token type.
static ScalarTokenType	TokenTypeConstant.TIME A description of the time token type.
static ScalarTokenType	TokenTypeConstant.TIMESTAMP A description of the timestamp token type.

Methods in com.pervasive.datarush.types that return ScalarTokenType

Modifier and Type	Method and Description
static ScalarTokenType	TokenTypeConstant.getScalar(String name) Gets the constant scalar token type descriptor for the specified name.
ScalarTokenType	ScalarTyped.getType()
ScalarTokenType	Field.getType() Gets the token type of the field.
static ScalarTokenType[]	TypeUtil.getTypes(RecordTokenType type) Returns the types of the fields of this record type.
static ScalarTokenType[]	TokenTypeConstant.scalars() Gets the descriptors for all supported scalar token types.
static ScalarTokenType	TypeUtil.valueOf(String type) Gets the named scalar type.
static ScalarTokenType	TypeUtil.widestType(ScalarTokenType... types) Determines the widest of the specified types.

Methods in com.pervasive.datarush.types with parameters of type ScalarTokenType

Modifier and Type	Method and Description
void	RecordTokenTypeBuilder.addField(String name, ScalarTokenType type) Adds a field with the specified name and type to this collection.
void	RecordTokenTypeBuilder.addField(String name, ScalarTokenType type, FieldDomain domain) Adds a field with the specified name and type to this collection.
void	RecordTokenTypeBuilder.addField(String name, ScalarTokenType type, Map<String,String> properties, FieldDomain domain, boolean primaryKey) Adds a field with the specified name and type to this collection.
void	FieldDomain.checkType(String field, ScalarTokenType type) Checks that the type of the domain matches the type of the field
static Field	TokenTypeConstant.field(ScalarTokenType type, String name) Constructs a field with the given name of the specified type.
static RecordTokenType	TypeUtil.homogeneousRecord(int size, ScalarTokenType fieldType, String fieldBase) Constructs a record type descriptor in which all fields have the same type.
static ScalarTokenType	TypeUtil.widestType(ScalarTokenType... types) Determines the widest of the specified types.
static RecordTokenType	TypeUtil.wrap(String name, ScalarTokenType type) Creates a new record type with a single named field of the given type.

Method parameters in com.pervasive.datarush.types with type arguments of type ScalarTokenType

Modifier and Type	Method and Description
static RecordTokenType	TypeUtil.toType(DataRepresentation representation, Namespace<ScalarTokenType> namespace) Converts from a list of fields to a record token type.
static RecordTokenType	TypeUtil.wrap(List<? extends ScalarTokenType> types) Creates a new record type with the specified field types.
static RecordTokenType	TypeUtil.wrap(String prefix, List<? extends ScalarTokenType> types) Creates a new record schema with the specified field types.

Uses of ScalarTokenType in com.pervasive.datarush.util

Methods in com.pervasive.datarush.util with parameters of type ScalarTokenType

Modifier and Type	Method and Description
static void	PropertyUtil.checkNumericMaxValuesByType(String propertyName, ScalarTokenType outputType, BigDecimal value) Checks that a numeric property value is not greater than the allowed maximum value for the given numeric type, which includes, TokenTypeConstant.INT, DOUBLE, FLOAT, NUMERIC, LONG.
ColumnSelector	ColumnSelector.setType(ScalarTokenType type) Sets the type of columns to include.