README.md in embulk-output-bigquery-0.3.1 vs README.md in embulk-output-bigquery-0.3.2
- old
+ new
@@ -19,10 +19,18 @@
* https://developers.google.com/bigquery/streaming-data-into-bigquery#usecases
Current version of this plugin supports Google API with Service Account Authentication, but does not support
OAuth flow for installed applications.
+### INCOMPATIBILITY CHANGES
+
+v0.3.x has incompatibility changes with v0.2.x. Please see [CHANGELOG.md](CHANGELOG.md) for details.
+
+* `formatter` option (formatter plugin support) is dropped. Use `source_format` option instead. (it already exists in v0.2.x too)
+* `encoders` option (encoder plugin support) is dropped. Use `compression` option instead (it already exists in v0.2.x too).
+* `mode: append` mode now expresses a transactional append, and `mode: append_direct` is one which is not transactional.
+
## Configuration
#### Original options
| name | type | required? | default | description |
@@ -43,9 +51,10 @@
| job_status_max_polling_time | int | optional | 3600 sec | Max job status polling time |
| job_status_polling_interval | int | optional | 10 sec | Job status polling interval |
| is_skip_job_result_check | boolean | optional | false | Skip waiting Load job finishes. Available for append, or delete_in_advance mode |
| with_rehearsal | boolean | optional | false | Load `rehearsal_counts` records as a rehearsal. Rehearsal loads into REHEARSAL temporary table, and delete finally. You may use this option to investigate data errors as early stage as possible |
| rehearsal_counts | integer | optional | 1000 | Specify number of records to load in a rehearsal |
+| abort_on_error | boolean | optional | true if max_bad_records is 0, otherwise false | Raise an error if number of input rows and number of output rows does not match |
| column_options | hash | optional | | [See below](#column-options) |
| default_timezone | string | optional | UTC | |
| default_timestamp_format | string | optional | %Y-%m-%d %H:%M:%S.%6N | |
| payload_column | string | optional | nil | [See below](#formatter-performance-issue) |
| payload_column_index | integer | optional | nil | [See below](#formatter-performance-issue) |