Sha256: 9d905950e78c2258b58b6262a4d419bd372df3c4b9c598c196b0419b576b18e5

Contents?: true

Size: 1.62 KB

Versions: 6

Compression:

Stored size: 1.62 KB

Contents

## case study

It is a guide to replicate multiple mysql table to elasticsearch.

## configuration

```
<source>
  @type mysql_replicator_multi

  # Database connection setting for manager table.
  manager_host localhost
  manager_username your_mysql_user
  manager_password your_mysql_password
  manager_database replicator_manager

  # Format output tag for each events. Placeholders usage as described below.
  tag replicator.${name}.${event}.${primary_key}
  # ${name} : the value of `replicator_manager.settings.name` in manager table.
  # ${event} : the variation of row event type by insert/update/delete.
  # ${primary_key} : the value of `replicator_manager.settings.primary_key` in manager table.
</source>

<match replicator.**>
  @type mysql_replicator_elasticsearch

  # Set Elasticsearch connection.
  host localhost
  port 9200

  # You can configure to use SSL for connecting to Elasticsearch.
  # ssl true

  # Basic authentication credentials can be configured
  # username basic_auth_username
  # password basic_auth_password

  # Set Elasticsearch index, type, and unique id (primary_key) from tag.
  tag_format (?<index_name>[^\.]+)\.(?<type_name>[^\.]+)\.(?<event>[^\.]+)\.(?<primary_key>[^\.]+)$

  # Set frequency of sending bulk request to Elasticsearch node.
  flush_interval 5s

  # Set maximum retry interval (required fluentd >= 0.10.41)
  max_retry_wait 1800

  # Queued chunks are flushed at shutdown process.
  # It's sample for td-agent. If you use Yamabiko, replace path from 'td-agent' to 'yamabiko'.
  flush_at_shutdown yes
  buffer_type file
  buffer_path /var/log/td-agent/buffer/mysql_replicator_elasticsearch
</match>
```

Version data entries

6 entries across 6 versions & 1 rubygems

Version Path
fluent-plugin-mysql-replicator-1.0.3 example/mysql_multi_table_to_elasticsearch.md
fluent-plugin-mysql-replicator-1.0.2 example/mysql_multi_table_to_elasticsearch.md
fluent-plugin-mysql-replicator-0.6.2 example/mysql_multi_table_to_elasticsearch.md
fluent-plugin-mysql-replicator-1.0.1 example/mysql_multi_table_to_elasticsearch.md
fluent-plugin-mysql-replicator-1.0.0 example/mysql_multi_table_to_elasticsearch.md
fluent-plugin-mysql-replicator-0.6.1 example/mysql_multi_table_to_elasticsearch.md