public class DeleteHBase extends KeyOperator
A DeleteMarker can be mapped to a select HBase cell or it can be mapped to a family as a sub table:
1. mapCellMarker(java.lang.String, java.lang.String, com.pervasive.datarush.hbase.DeleteHBase.DeleteMarker)
- Map a DeleteMarker to a select cell within a column family. A row key field
is required to uniquely id cells. A DeleteMarker will be inserted for each mapped cell qualifier, for each input record.
2. mapFamilyMarker(java.lang.String, com.pervasive.datarush.hbase.DeleteHBase.DeleteMarker)
- Map a DeleteMarker to a column family. If mapping DeleteMarker.DeleteFamily then only
a row key field is required, otherwise both a row key field and a qualifier key field are required to uniquely id cells.
A single DeleteMarker will be inserted for each input record.
A time key field can optionally be specified to allow the user to provide a timestamp value as part of the input record. If a time key field is not specified then each record will default to current time. If mapping DeleteMarker.Delete to delete a specific version of a cell then a time key field is required to uniquely id cells. DeleteMarkers that delete past versions will use the time key field or default to current time.
The input will be repartitioned using HBase table region row key ranges. Each partition will sort its DeleteMarkers in row key ascending, qualifier key ascending, time key descending order, and then write the DeleteMarkers to the appropriate regions.
If the specified HBase table does not exist then it will be created. The number of regions created will be MAX(4, the level of parallelism).
WriteHBase
,
ReadHBase
Modifier and Type | Class and Description |
---|---|
static class |
DeleteHBase.DeleteMarker |
catalogTableName, cellSchemaFamilyName, keySchemaFamilyName, statsFamilyName
Constructor and Description |
---|
DeleteHBase() |
Modifier and Type | Method and Description |
---|---|
void |
compose(CompositionContext ctx)
Compose the body of this operator.
|
Map<String,Map<String,DeleteHBase.DeleteMarker>> |
getCellMarkerMap() |
Map<String,DeleteHBase.DeleteMarker> |
getFamilyMarkerMap() |
RecordPort |
getInput() |
String |
getOutputPath()
Get the output path.
|
void |
mapCellMarker(String familyName,
String qualifier,
DeleteHBase.DeleteMarker marker)
Map DeleteMarker to a Cell.
|
void |
mapFamilyMarker(String familyName,
DeleteHBase.DeleteMarker marker)
Map DeleteMarker to a family.
|
void |
setCellMarkerMap(Map<String,Map<String,DeleteHBase.DeleteMarker>> cellMarkerMap) |
void |
setFamilyMarkerMap(Map<String,DeleteHBase.DeleteMarker> familyMarkerMap) |
void |
setOutputPath(String outputPath)
Set the output path.
|
addFamily, effectiveConfiguration, getConfiguration, getFamilies, getFilesystem, getHiveMetastore, getQualifierFieldMap, getRootDirectory, getRowFieldMap, getTableName, getTimeFieldName, getZookeeperParentZNode, getZookeeperPort, getZookeeperQuorum, mapQualifier, mapRow, mapRowRecord, setConfiguration, setFamilies, setFilesystem, setHiveMetastore, setQualifierFieldMap, setRootDirectory, setRowFieldMap, setTableName, setTimeFieldName, setZookeeperParentZNode, setZookeeperPort, setZookeeperQuorum
disableParallelism, getInputPorts, getOutputPorts, newInput, newInput, newOutput, newRecordInput, newRecordInput, newRecordOutput, notifyError
public Map<String,DeleteHBase.DeleteMarker> getFamilyMarkerMap()
public void setFamilyMarkerMap(Map<String,DeleteHBase.DeleteMarker> familyMarkerMap)
public Map<String,Map<String,DeleteHBase.DeleteMarker>> getCellMarkerMap()
public void setCellMarkerMap(Map<String,Map<String,DeleteHBase.DeleteMarker>> cellMarkerMap)
public String getOutputPath()
public void setOutputPath(String outputPath)
Optional property. Defaults to hdfs:/user/userName/
outputPath
- the output path.public RecordPort getInput()
public void mapCellMarker(String familyName, String qualifier, DeleteHBase.DeleteMarker marker)
familyName
- the name of the HBase column family.qualifier
- the HBase column qualifier identifying the cell to be mapped.marker
- the DeleteMarker to be mapped to the specified cell qualifier.public void mapFamilyMarker(String familyName, DeleteHBase.DeleteMarker marker)
familyName
- the name of the HBase column family.marker
- the DeleteMarker to be mapped to the specified family.public void compose(CompositionContext ctx)
CompositeOperator
OperatorComposable.add(O)
OperatorComposable.connect(P, P)
. This includes
connections from the composite's input ports to sub-operators, connections between sub-operators, and
connections from sub-operators output ports to the composite's output portscompose
in class CompositeOperator
ctx
- the contextCopyright © 2024 Actian Corporation. All rights reserved.