:plugin: dead_letter_queue :type: input :default_codec: plain /////////////////////////////////////////// START - GENERATED VARIABLES, DO NOT EDIT! /////////////////////////////////////////// :version: %VERSION% :release_date: %RELEASE_DATE% :changelog_url: %CHANGELOG_URL% :include_path: ../../../../logstash/docs/include /////////////////////////////////////////// END - GENERATED VARIABLES, DO NOT EDIT! /////////////////////////////////////////// [id="plugins-{type}s-{plugin}"] === Dead_letter_queue input plugin include::{include_path}/plugin_header.asciidoc[] ==== Description Logstash input to read events from Logstash's dead letter queue. [source, sh] ----------------------------------------- input { dead_letter_queue { path => "/var/logstash/data/dead_letter_queue" start_timestamp => "2017-04-04T23:40:37" } } ----------------------------------------- For more information about processing events in the dead letter queue, see {logstash-ref}/dead-letter-queues.html[Dead Letter Queues]. [id="plugins-{type}s-{plugin}-options"] ==== Dead_letter_queue Input Configuration Options This plugin supports the following configuration options plus the <> described later. [cols="<,<,<",options="header",] |======================================================================= |Setting |Input type|Required | <> |<>|No | <> |<>|No | <> |a valid filesystem path|Yes | <> |<>|No | <> |<>|No | <> |<>|No |======================================================================= Also see <> for a list of options supported by all input plugins.   [id="plugins-{type}s-{plugin}-clean_consumed"] ===== `clean_consumed` * Value type is <> * Default value is `false` When set to `true`, this option deletes the DLQ segments that have been read. This feature requires that `commit_offsets` is set to `true`. If not, you'll get a configuration error. This feature is available in Logstash 8.4.0 and later. If this setting is `true` and and you are using a Logstash version older than 8.4.0, then you'll get a configuration error. [id="plugins-{type}s-{plugin}-commit_offsets"] ===== `commit_offsets` * Value type is <> * Default value is `true` Specifies whether this input should commit offsets as it processes the events. Typically you specify `false` when you want to iterate multiple times over the events in the dead letter queue, but don't want to save state. This is when you are exploring the events in the dead letter queue. [id="plugins-{type}s-{plugin}-path"] ===== `path` * This is a required setting. * Value type is <> * There is no default value for this setting. Path to the dead letter queue directory that was created by a Logstash instance. This is the path from which "dead" events are read and is typically configured in the original Logstash instance with the setting `path.dead_letter_queue`. [id="plugins-{type}s-{plugin}-pipeline_id"] ===== `pipeline_id` * Value type is <> * Default value is `"main"` ID of the pipeline whose events you want to read from. [id="plugins-{type}s-{plugin}-sincedb_path"] ===== `sincedb_path` * Value type is <> * There is no default value for this setting. Path of the sincedb database file (keeps track of the current position of dead letter queue) that will be written to disk. The default will write sincedb files to `/plugins/inputs/dead_letter_queue`. NOTE: This value must be a file path and not a directory path. [id="plugins-{type}s-{plugin}-start_timestamp"] ===== `start_timestamp` * Value type is <> * There is no default value for this setting. Timestamp in ISO8601 format from when you want to start processing the events from. For example, `2017-04-04T23:40:37`. [id="plugins-{type}s-{plugin}-common-options"] include::{include_path}/{type}.asciidoc[] :default_codec!: