Sha256: e331452cbc7fdef1cb93fcf24a620dcc57eb43e5937a61e84a4b8cfb2002129b

Contents?: true

Size: 1.71 KB

Versions: 1

Compression:

Stored size: 1.71 KB

Contents

# Athena input plugin for Embulk

[![Gem Version](https://badge.fury.io/rb/embulk-input-athena.svg)](https://badge.fury.io/rb/embulk-input-athena)
[![MIT License](http://img.shields.io/badge/license-MIT-blue.svg?style=flat)](LICENSE)

Athena input plugin for Embulk loads records from Athena(AWS).

## Overview

* **Plugin type**: input
* **Resume supported**: no
* **Cleanup supported**: no
* **Guess supported**: no

## Configuration

* **driver_path**: path to the jar file of the Athena JDBC driver. If not set, the bundled JDBC driver(AthenaJDBC41.jar) will be used. (string)
* **database**: database name (string, required)
* **athena_url**: Athena url (string, required)
* **s3_staging_dir**: The S3 location to which your query output is written, for example s3://query-results-bucket/folder/. (string, required)
* **access_key**: AWS access key (string, required)
* **secret_key**: AWS secret key (string, required)
* **query**: SQL to run (string, required)
* **columns**: columns (string, required)
* **options**: extra JDBC properties (string, default: {})
* **null_to_zero**: if true, convert long, double and boolean value from null to zero (boolean, default: false)

## Example

```yaml
in:
  type: athena
  database: log_test
  athena_url: "jdbc:awsathena://athena.ap-northeast-1.amazonaws.com:443"
  s3_staging_dir: "s3://aws-athena-query-results-11111111111-ap-northeast-1/"
  access_key: ""
  secret_key: ""
  query: |
    select uid, created_at from log_test.sample
  columns:
    - {name: uid, type: string}
    - {name: created_at, type: timestamp}
  null_to_zero: true
```

## Build

```bash
$ docker-compose up -d
$ docker-compose exec embulk bash
embulk>$ ./gradlew gem  # -t to watch change of files and rebuild continuously
```

Version data entries

1 entries across 1 versions & 1 rubygems

Version Path
embulk-input-athena-0.1.7 README.md