Sha256: 87015e8450216e21e0b0e93727fdb56e8d64cc359d375b8024f317b358df0459
Contents?: true
Size: 1.2 KB
Versions: 4
Compression:
Stored size: 1.2 KB
Contents
# Command file output plugin for Embulk This plugin runs a command and writes formatted data to its stdin. ## Overview * **Plugin type**: file output * **Load all or nothing**: depends on the command * **Resume supported**: depends on the command ## Configuration - **command**: command line (string, required) The **command** is exected using a shell. So it can include pipe (`|`), environment variables (`$VAR`), redirects, and so on. The command runs `total-task-count * total-seqid-count` times. For example, if there is 3 local files and formatter produces 2 files for each input file, the command is executed for 6 times. ### Environment variables The command can use following environment variables: - **INDEX**: task index (0, 1, 2, ...). This depends on input. For example, the input is local files, incremental numbers for each file. - **SEQID**: file sequence id in a task. This depends on formatter. For example, if the formatter produces 2 files, the SEQID is 0 and 1. You can use the combination of (INDEX, SEQID) as an unique identifier of a task. ## Example ```yaml out: type: command command: "cat - > task.$INDEX.$SEQID.csv" formatter: type: csv ``` ## Build ``` $ ./gradlew gem ```
Version data entries
4 entries across 4 versions & 1 rubygems
Version | Path |
---|---|
embulk-output-command-0.1.3 | README.md |
embulk-output-command-0.1.2 | README.md |
embulk-output-command-0.1.1 | README.md |
embulk-output-command-0.1.0 | README.md |