docs/index.asciidoc in logstash-input-s3-3.6.0 vs docs/index.asciidoc in logstash-input-s3-3.7.0

- old
+ new

@@ -29,10 +29,25 @@ Each line from each file generates an event. Files ending in `.gz` are handled as gzip'ed files. Files that are archived to AWS Glacier will be skipped. +[id="plugins-{type}s-{plugin}-ecs_metadata"] +==== Event Metadata and the Elastic Common Schema (ECS) +This plugin adds cloudfront metadata to event. +When ECS compatibility is disabled, the value is stored in the root level. +When ECS is enabled, the value is stored in the `@metadata` where it can be used by other plugins in your pipeline. + +Here’s how ECS compatibility mode affects output. +[cols="<l,<l,e,<e"] +|======================================================================= +| ECS disabled | ECS v1 | Availability | Description + +| cloudfront_fields | [@metadata][s3][cloudfront][fields] | available when the file is a CloudFront log | column names of log +| cloudfront_version | [@metadata][s3][cloudfront][version] | available when the file is a CloudFront log | version of log +|======================================================================= + [id="plugins-{type}s-{plugin}-options"] ==== S3 Input Configuration Options This plugin supports the following configuration options plus the <<plugins-{type}s-{plugin}-common-options>> described later. @@ -45,10 +60,11 @@ | <<plugins-{type}s-{plugin}-backup_add_prefix>> |<<string,string>>|No | <<plugins-{type}s-{plugin}-backup_to_bucket>> |<<string,string>>|No | <<plugins-{type}s-{plugin}-backup_to_dir>> |<<string,string>>|No | <<plugins-{type}s-{plugin}-bucket>> |<<string,string>>|Yes | <<plugins-{type}s-{plugin}-delete>> |<<boolean,boolean>>|No +| <<plugins-{type}s-{plugin}-ecs_compatibility>> |<<string,string>>|No | <<plugins-{type}s-{plugin}-endpoint>> |<<string,string>>|No | <<plugins-{type}s-{plugin}-exclude_pattern>> |<<string,string>>|No | <<plugins-{type}s-{plugin}-gzip_pattern>> |<<string,string>>|No | <<plugins-{type}s-{plugin}-include_object_properties>> |<<boolean,boolean>>|No | <<plugins-{type}s-{plugin}-interval>> |<<number,number>>|No @@ -94,16 +110,16 @@ the connection to s3. See full list in https://docs.aws.amazon.com/sdkforruby/api/Aws/S3/Client.html[the AWS SDK documentation]. Example: [source,ruby] input { s3 { - "access_key_id" => "1234" - "secret_access_key" => "secret" - "bucket" => "logstash-test" - "additional_settings" => { - "force_path_style" => true - "follow_redirects" => false + access_key_id => "1234" + secret_access_key => "secret" + bucket => "logstash-test" + additional_settings => { + force_path_style => true + follow_redirects => false } } } [id="plugins-{type}s-{plugin}-aws_credentials_file"] @@ -164,9 +180,21 @@ * Value type is <<boolean,boolean>> * Default value is `false` Whether to delete processed files from the original bucket. + +[id="plugins-{type}s-{plugin}-ecs_compatibility"] +===== `ecs_compatibility` + + * Value type is <<string,string>> + * Supported values are: + ** `disabled`: does not use ECS-compatible field names + ** `v1`: uses metadata fields that are compatible with Elastic Common Schema + +Controls this plugin's compatibility with the +{ecs-ref}[Elastic Common Schema (ECS)]. +See <<plugins-{type}s-{plugin}-ecs_metadata>> for detailed information. [id="plugins-{type}s-{plugin}-endpoint"] ===== `endpoint` * Value type is <<string,string>>