public class RemoveDuplicates extends CompositeOperator implements RecordPipelineOperator
sortKeys
.
If sortKeys
is unspecified, then this will output an arbitrary row.Constructor and Description |
---|
RemoveDuplicates()
Default constructor.
|
RemoveDuplicates(List<String> groupKeys)
Remove duplicates, specifying keys.
|
Modifier and Type | Method and Description |
---|---|
protected void |
compose(CompositionContext ctx)
Compose the body of this operator.
|
String[] |
getGroupKeys()
Returns the keys by which to de-duplicate.
|
RecordPort |
getInput()
Returns the data to be de-duplicated
|
RecordPort |
getOutput()
Returns the de-duplicated data
|
SortKey[] |
getSortKeys()
Returns the additional keys by which to sort the data to determine
which row to output in the event of a duplicate.
|
void |
setGroupKeys(String[] groupKeys)
Sets the keys by which to de-duplicate.
|
void |
setSortKeys(SortKey[] sortKeys)
Sets the additional keys by which to sort the data to determine
which row to output in the event of a duplicate.
|
void |
setSortKeys(String... keys)
Sets the additional keys by which to sort the data to determine
which row to output in the event of a duplicate.
|
disableParallelism, getInputPorts, getOutputPorts, newInput, newInput, newOutput, newRecordInput, newRecordInput, newRecordOutput, notifyError
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
disableParallelism, getInputPorts, getOutputPorts
public RemoveDuplicates()
public RecordPort getInput()
getInput
in interface PipelineOperator<RecordPort>
public RecordPort getOutput()
getOutput
in interface PipelineOperator<RecordPort>
protected void compose(CompositionContext ctx)
CompositeOperator
OperatorComposable.add(O)
OperatorComposable.connect(P, P)
. This includes
connections from the composite's input ports to sub-operators, connections between sub-operators, and
connections from sub-operators output ports to the composite's output portscompose
in class CompositeOperator
ctx
- the contextpublic String[] getGroupKeys()
public void setGroupKeys(String[] groupKeys)
groupKeys
- the keys by which to de-duplicate.public SortKey[] getSortKeys()
public void setSortKeys(SortKey[] sortKeys)
sortKeys
- the additional keys by which to sort the datapublic void setSortKeys(String... keys)
keys
- the additional keys by which to sort the dataCopyright © 2016 Actian Corporation. All rights reserved.