## Tutorial for Quickstart (mysql_replicator) It is useful for these purpose. * try it on this plugin quickly. * replicate small record under a millons table. **Note:** On syncing 300 million rows table, it will consume around 800MB of memory with ruby 1.9.3 environment. ### configuration ````` type mysql_replicator # Set connection settings for replicate source. host localhost username your_mysql_user password your_mysql_password database myweb # Set replicate query configuration. query SELECT id, text, updated_at from search_test; primary_key id # specify unique key (default: id) interval 10s # execute query interval (default: 1m) # Enable detect deletion event not only insert/update events. (default: yes) # It is useful to use `enable_delete no` that keep following recently updated record with this query. # `SELECT * FROM search_test WHERE DATE_ADD(updated_at, INTERVAL 5 MINUTE) > NOW();` enable_delete yes # Format output tag for each events. Placeholders usage as described below. tag replicator.myweb.search_test.${event}.${primary_key} # ${event} : the variation of row event type by insert/update/delete. # ${primary_key} : the value of `replicator_manager.settings.primary_key` in manager table. type copy type stdout type mysql_replicator_elasticsearch # Set Elasticsearch connection. host localhost port 9200 # Set Elasticsearch index, type, and unique id (primary_key) from tag. tag_format (?[^\.]+)\.(?[^\.]+)\.(?[^\.]+)\.(?[^\.]+)$ # Set frequency of sending bulk request to Elasticsearch node. flush_interval 5s # Queued chunks are flushed at shutdown process. (recommend for more stability) # It's sample for td-agent. If you use Yamabiko, replace path from 'td-agent' to 'yamabiko'. flush_at_shutdown yes buffer_type file buffer_path /var/log/td-agent/buffer/mysql_replicator_elasticsearch `````