LoadActianVector
; use that operator instead.@Deprecated public class LoadVectorOnHadoop extends CompositeOperator implements RecordSinkOperator
vwload
is invoked to load the intermediate files from HDFS into Vector on Hadoop.
Once the load completes, the intermediate files are removed from HDFS.
The output of the vwload
utility is captured and logged by the operator. If any
errors occur, the logged output can be used to determine the issue.
Constructor and Description |
---|
LoadVectorOnHadoop()
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
protected void |
compose(CompositionContext ctx)
Deprecated.
Compose the body of this operator.
|
String |
getCharset()
Deprecated.
Get the character set used when staging and loading for vwload method for Vectorwise operator.
|
String |
getDatabase()
Deprecated.
Get the database name.
|
String |
getFinalizeTableSQL()
Deprecated.
Retrieves the SQL statement to execute after processing all the records.
|
String |
getHost()
Deprecated.
Get the server host name property.
|
String |
getInitializeTableSQL()
Deprecated.
Retrieves the SQL statement to execute before processing any records.
|
RecordPort |
getInput()
Deprecated.
Gets the record port providing the input data to the sink.
|
String |
getInstance()
Deprecated.
Get the Vectorwise instance name.
|
int |
getMaxErrors()
Deprecated.
Get the maximum number of errors allowed.
|
String |
getPassword()
Deprecated.
Get the password.
|
Map<String,String> |
getRenameMapping()
Deprecated.
Get the source to target field mapping.
|
boolean |
getRollback()
Deprecated.
Get whether rollback is enabled or disabled.
|
String |
getSshPassword()
Deprecated.
Password for SSH User id
|
String |
getSshUser()
Deprecated.
OS user id used to connect to NameNode of the Hadoop installation.
|
String |
getTable()
Deprecated.
Get the target table name.
|
String |
getTmpDirectory()
Deprecated.
|
String |
getUser()
Deprecated.
Get the user account name.
|
void |
setCharset(String charsetName)
Deprecated.
Set the character set used for data staging and loading for vwload load method.
|
void |
setDatabase(String database)
Deprecated.
Set the database name.
|
void |
setFinalizeTableSQL(String finalizeTableSQL)
Deprecated.
Sets the SQL statement to execute after processing all the records.
|
void |
setHost(String hostName)
Deprecated.
Set the host name property.
|
void |
setInitializeTableSQL(String initializeTableSQL)
Deprecated.
Sets the SQL statement to execute before processing any records.
|
void |
setInstance(String instance)
Deprecated.
Set the Vectorwise instance name.
|
void |
setMaxErrors(int maxErrors)
Deprecated.
Set the maximum number of errors allowed before rolling back the data load operation.
|
void |
setPassword(String password)
Deprecated.
Set the user's password.
|
void |
setRenameMapping(Map<String,String> renameMapping)
Deprecated.
Set a rename mapping.
|
void |
setRollback(boolean enabled)
Deprecated.
Enable or disable rollback processing.
|
void |
setSshPassword(String passwd)
Deprecated.
Set the password for SSH user id
|
void |
setSshUser(String user)
Deprecated.
Set the OS User Id used for authenticating SSH connection to Master Node of Vector on Hadoop
|
void |
setTable(String table)
Deprecated.
Set the name of the table to load.
|
void |
setTmpDirectory(String tmpDirectory)
Deprecated.
Set the temporary directory that is to be used for storing the intermediate loader files.
|
void |
setUser(String userName)
Deprecated.
Set the user name.
|
disableParallelism, getInputPorts, getOutputPorts, newInput, newInput, newOutput, newRecordInput, newRecordInput, newRecordOutput, notifyError
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
disableParallelism, getInputPorts, getOutputPorts
public RecordPort getInput()
RecordSinkOperator
getInput
in interface RecordSinkOperator
getInput
in interface SinkOperator<RecordPort>
public String getHost()
public void setHost(String hostName)
hostName
- Vectorwise server host namepublic String getInstance()
public void setInstance(String instance)
instanceName
- instance namepublic String getDatabase()
public void setDatabase(String database)
database
- database namepublic String getTable()
public void setTable(String table)
table
- target table name.public String getUser()
public void setUser(String userName)
When using the vwload load method, the user name is not always needed. The vwload utility has to be executed by the DBA user. The user name and password supplied is for a user account that has write/copy access to the target table.
userName
- user account namepublic String getPassword()
public void setPassword(String password)
When using the vwload load method, the password is not always needed. The vwload utility has to be executed by the DBA user. The user name and password supplied is for a user account that has write/copy access to the target table.
password
- public Map<String,String> getRenameMapping()
public void setRenameMapping(Map<String,String> renameMapping)
This is an optional property. If not provided, the input fields are mapped to the target database table by schema order.
renameMapping
- the mapping from old to new names.public int getMaxErrors()
public void setMaxErrors(int maxErrors)
maxErrors
- maximum errors allowedpublic boolean getRollback()
public void setRollback(boolean enabled)
If disabled, the operation is still aborted when the maximum number of errors has been encountered. However, the data load is not rolled back. Any data successfully loaded will appear in the target table.
rollback
- enable (true) or disable (false) rollbackpublic String getSshUser()
public void setSshUser(String user)
user
- public void setSshPassword(String passwd)
password
- for user idpublic String getSshPassword()
public String getInitializeTableSQL()
public void setInitializeTableSQL(String initializeTableSQL)
CREATE TABLE
statement to create the table.
This statement is executed only once, regardless of #partitionCount
.
initializeTableSQL
- the SQL statement to execute before processing any recordspublic String getFinalizeTableSQL()
public void setFinalizeTableSQL(String finalizeTableSQL)
CREATE INDEX
statement.
This statement is executed only once, regardless of #partitionCount
.
finalizeTableSQL
- the SQL statement to execute after processing all the recordspublic String getTmpDirectory()
public void setTmpDirectory(String tmpDirectory)
tmpDirectory
- path to the temporary directorypublic void setCharset(String charsetName)
charsetName
- character set used when staging and loading for vwload methodpublic String getCharset()
protected void compose(CompositionContext ctx)
CompositeOperator
OperatorComposable.add(O)
OperatorComposable.connect(P, P)
. This includes
connections from the composite's input ports to sub-operators, connections between sub-operators, and
connections from sub-operators output ports to the composite's output portscompose
in class CompositeOperator
ctx
- the contextCopyright © 2021 Actian Corporation. All rights reserved.