CHANGELOG in activewarehouse-etl-0.6.1 vs CHANGELOG in activewarehouse-etl-0.7.0

- old
+ new

@@ -65,6 +65,34 @@ dependencies are executed in the order they are specified. * The default field separator in the bulk loader is now a comma (was a tab). 0.6.1 - Mar 22, 2007 * Added support for absolute paths in file sources -* Added CopyFieldProcessor +* Added CopyFieldProcessor + +0.7 - Apr 8, 2007 +* Job execution is now tracked in a database. This means that ActiveRecord is required regardless + of the sources being used in the ETL scripts. An example database configuration for the etl can + be found in test/database.example.yml. This file is loaded from either a.) the current working + directory or b.) the location specified using the -c command line argument when running the + etl command. +* etl script now supports the following command line arguments: +** -h or --help: Prints the usage +** -l or --limit: Specifies a limit for the number of source rows to read, useful for testing + your control files before executing a full ETL process +** -o or --offset: Specified a start offset for reading from the source, useful for testing your + control files before executing a full ETL process +** -c or --config: Specify the database.yml file to configure the ETL execution data store +** -n or --newlog: Write to the logfile rather than appending to it +* Database source now supports specifying the select, join and order parts of the query. +* Database source understands the limit argument specified on the etl command line +* Added CheckExistProcessor +* Added CheckUniqueProcessor +* Added SurrogateKeyProcessor. The SurrogateKey processor should be used in conjunction with the + CheckExistProcessor and CheckUniqueProcessor to provide +* Added SequenceProcessor +* Added OrdinalizeTransform +* Fixed a bug in the trim transform +* Sources now provide a trigger file which can be used to indicate that the original source + data has been completely extracted to the local file system. This is useful if you need to + recover from a failed ETL process. +* Updated README \ No newline at end of file