Contents

# TODO:
# Test this (a bit of a bugger, because I need to fail at every callback and make sure that I can recover.)
# Get the logging done and demonstrated, because an ETL process without good logging really is useless.
# Include a logging example for syslog-ng and syslog
# Work through some bucket thoughts that I was having this morning: how to take random percepts and create consolidated snapshots of an environment at a point in time.  This is driven from the belief maintenance systems, but certainly needs to be worked out.
# Figure out if TeguGears really should be doing this.  Come back to how I'll parallelize this process.  Demonstrate running this in parallel.

require 'rubygems'
require 'activesupport'
require 'ostruct'
require 'log4r'
require 'fileutils'

def load_gem_casually(name)
  begin
    gem name
    require name
  rescue Gem::LoadError
    # Do nothing if this is not available.  It's a convenience, not a requirement.
  end
end

load_gem_casually('tegu_gears')
load_gem_casually('data_frame')
load_gem_casually('babel_icious')

Dir.glob("#{File.dirname(__FILE__)}/helpers/*.rb").each { |file| require file }

$:.unshift(File.dirname(__FILE__))

class ExtractError < StandardError; end
class TransformError < StandardError; end
# Note, LoadError is already used.
class LoadingError < StandardError; end

require 'etl/etl'

Version data entries

6 entries across 6 versions & 1 rubygems

Version	Path
davidrichards-etl-0.0.10	lib/etl.rb
davidrichards-etl-0.0.4	lib/etl.rb
davidrichards-etl-0.0.5	lib/etl.rb
davidrichards-etl-0.0.6	lib/etl.rb
davidrichards-etl-0.0.7	lib/etl.rb
davidrichards-etl-0.0.9	lib/etl.rb