docs/index.asciidoc in logstash-input-s3-3.6.0 vs docs/index.asciidoc in logstash-input-s3-3.7.0
- old
+ new
@@ -29,10 +29,25 @@
Each line from each file generates an event.
Files ending in `.gz` are handled as gzip'ed files.
Files that are archived to AWS Glacier will be skipped.
+[id="plugins-{type}s-{plugin}-ecs_metadata"]
+==== Event Metadata and the Elastic Common Schema (ECS)
+This plugin adds cloudfront metadata to event.
+When ECS compatibility is disabled, the value is stored in the root level.
+When ECS is enabled, the value is stored in the `@metadata` where it can be used by other plugins in your pipeline.
+
+Here’s how ECS compatibility mode affects output.
+[cols="<l,<l,e,<e"]
+|=======================================================================
+| ECS disabled | ECS v1 | Availability | Description
+
+| cloudfront_fields | [@metadata][s3][cloudfront][fields] | available when the file is a CloudFront log | column names of log
+| cloudfront_version | [@metadata][s3][cloudfront][version] | available when the file is a CloudFront log | version of log
+|=======================================================================
+
[id="plugins-{type}s-{plugin}-options"]
==== S3 Input Configuration Options
This plugin supports the following configuration options plus the <<plugins-{type}s-{plugin}-common-options>> described later.
@@ -45,10 +60,11 @@
| <<plugins-{type}s-{plugin}-backup_add_prefix>> |<<string,string>>|No
| <<plugins-{type}s-{plugin}-backup_to_bucket>> |<<string,string>>|No
| <<plugins-{type}s-{plugin}-backup_to_dir>> |<<string,string>>|No
| <<plugins-{type}s-{plugin}-bucket>> |<<string,string>>|Yes
| <<plugins-{type}s-{plugin}-delete>> |<<boolean,boolean>>|No
+| <<plugins-{type}s-{plugin}-ecs_compatibility>> |<<string,string>>|No
| <<plugins-{type}s-{plugin}-endpoint>> |<<string,string>>|No
| <<plugins-{type}s-{plugin}-exclude_pattern>> |<<string,string>>|No
| <<plugins-{type}s-{plugin}-gzip_pattern>> |<<string,string>>|No
| <<plugins-{type}s-{plugin}-include_object_properties>> |<<boolean,boolean>>|No
| <<plugins-{type}s-{plugin}-interval>> |<<number,number>>|No
@@ -94,16 +110,16 @@
the connection to s3. See full list in https://docs.aws.amazon.com/sdkforruby/api/Aws/S3/Client.html[the AWS SDK documentation]. Example:
[source,ruby]
input {
s3 {
- "access_key_id" => "1234"
- "secret_access_key" => "secret"
- "bucket" => "logstash-test"
- "additional_settings" => {
- "force_path_style" => true
- "follow_redirects" => false
+ access_key_id => "1234"
+ secret_access_key => "secret"
+ bucket => "logstash-test"
+ additional_settings => {
+ force_path_style => true
+ follow_redirects => false
}
}
}
[id="plugins-{type}s-{plugin}-aws_credentials_file"]
@@ -164,9 +180,21 @@
* Value type is <<boolean,boolean>>
* Default value is `false`
Whether to delete processed files from the original bucket.
+
+[id="plugins-{type}s-{plugin}-ecs_compatibility"]
+===== `ecs_compatibility`
+
+ * Value type is <<string,string>>
+ * Supported values are:
+ ** `disabled`: does not use ECS-compatible field names
+ ** `v1`: uses metadata fields that are compatible with Elastic Common Schema
+
+Controls this plugin's compatibility with the
+{ecs-ref}[Elastic Common Schema (ECS)].
+See <<plugins-{type}s-{plugin}-ecs_metadata>> for detailed information.
[id="plugins-{type}s-{plugin}-endpoint"]
===== `endpoint`
* Value type is <<string,string>>