Customizing ETL with ArtifactRegister.sh

Use the ArtifactRegister.sh command to customize the ETL logic.

The ETL process contains 10 steps. Most of them are generated by the system automatically. If you want to change the ETL behavior, for example, adding more data clean rules, you might want to override the ETL logic with your own SQL commands.

Refer to Vertica for PPM Reporting Customization Guide for more information about how to override the ETL logic.

The following table describes the supported parameters.

Parameter

Mandatory?

Sample Value

Description

streamname

Yes

PPM_PERSON_STREAM

ETL stream name

etlstep

Yes

EXT|SSI|TSNP|XREF|MSI|

XFR|KEYLOOKUP|TARGET|

HIERARCHY|POSTTARGET

ETL step

artifactfile

Yes

/temp/XREF.SQL

SQL file that contains customized ETL logic

register

No

CUSTOMIZATION

All non-HP provided SQL commands shall be registered as CUSTOMIZATION

help

No

 

Prints put the help message

For example, to customize the ETL logic of the PPM_DATE_STREAM stream for the KEYLOOKUP step, use the following command:

sh $VDW_HOME/bin/ArtifactRegister.sh --streamname PPM_DATE_STREAM --etlstep KEYLOOKUP --artifactfile $VDW_HOME/Content/TARGET.cp/scripts/SQL/DATE/KEYLOOKUP.SQL --register CUSTOMIZATION