Sha256: b2410b15dcd67115178811cfaf245ed3eedf2661c59106ad86a2463e71a6d838
Contents?: true
Size: 1.96 KB
Versions: 1
Compression:
Stored size: 1.96 KB
Contents
# Orc output plugin for Embulk [](https://travis-ci.org/yuokada/embulk-output-orc) [](https://badge.fury.io/rb/embulk-output-orc) ## Overview * **Plugin type**: output * **Load all or nothing**: no * **Resume supported**: no * **Cleanup supported**: yes ## Configuration - **path_prefix**: A prefix of output path. (string, required) - support: `file`, `s3n` and `s3a`. - **file_ext**: An extension of output file. (string, default: `.orc`) - **sequence_format**: (string, default: `.%03d`) - **buffer_size**: Set the ORC buffer size (integer, default: `262144`) - **strip_size**: Set the ORC strip size (integer, default: `67108864`) - **block_size**: Set the ORC block size (integer, default: `268435456`) - **compression_kind**: description (string, default: `'ZLIB'`) - `NONE`, `ZLIB`, `SNAPPY` - **overwrite**: (LocalFileSystem only) Overwrite if output files already exist. (boolean, default: `false`) - **default_from_timezone** Time zone of timestamp columns. This can be overwritten for each column using column_options (DateTimeZone, default: `UTC`) - **auth_method**: name of mechanism to authenticate requests (basic, env, instance, profile, properties, anonymous, or session. default: basic) see: https://github.com/embulk/embulk-input-s3#configuration - `env`, `basic`, `profile`, `default`, `session`, `anonymous`, `properties` ## Example ```yaml out: type: orc path_prefix: "/tmp/output" buffer_size: 8000 strip_size: 90000 compression_kind: ZLIB overwrite: true ``` ## ChangeLog ### ver 0.2.0 - support: output to s3 - `s3n`, `s3a` protocol ### ver 0.1.0 - initial release ## Build ``` $ ./gradlew gem # -t to watch change of files and rebuild continuously ``` ## SonarQube [embulk-output-orc](https://sonarcloud.io/dashboard?id=embulk-output-orc "embulk-output-orc - Yukihiro Okada")
Version data entries
1 entries across 1 versions & 1 rubygems
Version | Path |
---|---|
embulk-output-orc-0.3.0 | README.md |