Sha256: dbe570a7d6cae489ef0493968b0abe4aa5ea3bb969487c08bf96c329d4d387f9

Contents?: true

Size: 608 Bytes

Versions: 3

Compression:

Stored size: 608 Bytes

Contents

in:
  type: file
  path_prefix: ./example/data.tsv
  parser:
    type: csv
    delimiter: "\t"
    skip_header_lines: 0
    null_string: ""
    columns:
      - { name: id, type: long }
      - { name: description, type: string }
      - { name: name, type: string }
      - { name: t, type: timestamp, format: "%Y-%m-%d %H:%M:%S %z"}
      - { name: payload, type: json}
    stop_on_invalid_record: true

out:
  type: s3_parquet
  bucket: my-bucket
  path_prefix: path/to/my-obj.
  file_ext: snappy.parquet
  compression_codec: snappy
  default_timezone: Asia/Tokyo
  canned_acl: bucket-owner-full-control

Version data entries

3 entries across 3 versions & 1 rubygems

Version Path
embulk-output-s3_parquet-0.1.0 example/config.yml
embulk-output-s3_parquet-0.0.3 example/config.yml
embulk-output-s3_parquet-0.0.2 example/config.yml