Sha256: cad5f6ca9adf43ef08375e27a12344653b9b5673904e9d53d3943c69f0206273

Contents?: true

Size: 989 Bytes

Versions: 1

Compression:

Stored size: 989 Bytes

Contents

# Splitting input file plugin for Embulk

This Embulk plugin splits and inputs a text file.
By splitting a file, input tasks will be executed in multithreads and the performance will be improved.

Lines of the text file should be separated by CR or LF or CRLF.
The plugin searches line separators and splits a file properly.

## Overview

* **Plugin type**: input

## Configuration

- **path**: the path of a text file (string, either this or path_prefix is required)
- **path_prefix**: the path prefix of text files (string, either this or path_prefix is required)
- **header_line**: whether the first line is a header or not (boolean, default: false)
- **tasks**: number of tasks (integer, default: number of available processors * 2)

### Example

```yaml
in:
  type: filesplit
  path: '/data/address.csv'
  header_line: true
  tasks: 4
  parser:
    charset: UTF-8
    newline: CRLF
    type: csv
    header_line: true
    delimiter: ','
    ...
```

### Build

```
$ ./gradle gem
```

Version data entries

1 entries across 1 versions & 1 rubygems

Version Path
embulk-input-filesplit-0.1.4 README.md