Sha256: b2410b15dcd67115178811cfaf245ed3eedf2661c59106ad86a2463e71a6d838

Contents?: true

Size: 1.96 KB

Versions: 1

Compression:

Stored size: 1.96 KB

Contents

# Orc output plugin for Embulk

[![Build Status](https://travis-ci.org/yuokada/embulk-output-orc.svg?branch=master)](https://travis-ci.org/yuokada/embulk-output-orc)
[![Gem Version](https://badge.fury.io/rb/embulk-output-orc.svg)](https://badge.fury.io/rb/embulk-output-orc)

## Overview

* **Plugin type**: output
* **Load all or nothing**: no
* **Resume supported**: no
* **Cleanup supported**: yes

## Configuration

- **path_prefix**: A prefix of output path. (string, required)
  - support: `file`, `s3n` and `s3a`.
- **file_ext**: An extension of output file. (string, default: `.orc`)
- **sequence_format**: (string, default: `.%03d`)
- **buffer_size**: Set the ORC buffer size (integer, default: `262144`)
- **strip_size**: Set the ORC strip size (integer,  default: `67108864`)
- **block_size**: Set the ORC block size (integer, default: `268435456`)
- **compression_kind**: description (string, default: `'ZLIB'`)
    - `NONE`, `ZLIB`, `SNAPPY`
- **overwrite**: (LocalFileSystem only) Overwrite if output files already exist. (boolean, default: `false`)
- **default_from_timezone** Time zone of timestamp columns. This can be overwritten for each column using column_options (DateTimeZone, default: `UTC`)

- **auth_method**: name of mechanism to authenticate requests (basic, env, instance, profile, properties, anonymous, or session. default: basic)  
  see: https://github.com/embulk/embulk-input-s3#configuration

    - `env`, `basic`, `profile`, `default`, `session`, `anonymous`, `properties`
    

## Example

```yaml
out:
  type: orc
  path_prefix: "/tmp/output"
  buffer_size: 8000
  strip_size:  90000
  compression_kind: ZLIB
  overwrite:   true
```

## ChangeLog

### ver 0.2.0

- support: output to s3

    - `s3n`, `s3a` protocol

### ver 0.1.0

- initial release

## Build

```
$ ./gradlew gem  # -t to watch change of files and rebuild continuously
```

## SonarQube

[embulk-output-orc](https://sonarcloud.io/dashboard?id=embulk-output-orc "embulk-output-orc - Yukihiro Okada")

Version data entries

1 entries across 1 versions & 1 rubygems

Version Path
embulk-output-orc-0.3.0 README.md