Sha256: 33f4a2ee54adf27290a7e08dc436a0b65d432130d05f0800dba3ae9617a2e133
Contents?: true
Size: 986 Bytes
Versions: 10
Compression:
Stored size: 986 Bytes
Contents
TODO * Add build-in support for audit_dimension * Do not rerun the processing if it isn't needed, i.e. the source and control files have not been modified (allow forced override) * Provide greater control in error handling ** Allow a error threshold ** Don't die completely if a parse error, just stop processing that specific file if error threshold is reached ** Allow mismatch row length error in delimited parser to be ignored * Improve error messages throughout, but especially in problems with the control files * Add support for determining if a row should be added, updated or removed vs. just blindly inserting * Add support for paritioned views during the insert process. Use specifiable columns as the trigger columns for determining the data output destination. Audit Record Process-Level * Start Time * End Time * (Duration) * Rows Read * Rows Written * Rows Rejected * Errors * Destination Record-Level * Source * Timestamp * Transformation Log
Version data entries
10 entries across 10 versions & 1 rubygems