Sha256: b20dfbaf61be6094b74144f51723e337a9fe8dfd043f5262f3100552a91133f9

Contents?: true

Size: 1.2 KB

Versions: 18

Compression:

Stored size: 1.2 KB

Contents

require 'stringio'
require 'gherkin/token'
require 'gherkin/gherkin_line'

module Gherkin
  # The scanner reads a gherkin doc (typically read from a .feature file) and
  # creates a token for line. The tokens are passed to the parser, which outputs
  # an AST (Abstract Syntax Tree).
  #
  # If the scanner sees a # language header, it will reconfigure itself dynamically
  # to look for Gherkin keywords for the associated language. The keywords are defined
  # in gherkin-languages.json.
  class TokenScanner
    def initialize(source_or_io)
      @line_number = 0

      case(source_or_io)
      when String
        @io = StringIO.new(source_or_io)
      when StringIO, IO
        @io = source_or_io
      else
        fail ArgumentError, "Please a pass String, StringIO or IO. I got a #{source_or_io.class}"
      end
    end

    def read
      location = {line: @line_number += 1, column: 0}
      if @io.nil? || line = @io.gets
        gherkin_line = line ? GherkinLine.new(line, location[:line]) : nil
        Token.new(gherkin_line, location)
      else
        @io.close unless @io.closed? # ARGF closes the last file after final gets
        @io = nil
        Token.new(nil, location)
      end
    end

  end
end

Version data entries

18 entries across 18 versions & 3 rubygems

Version Path
cucumber-gherkin-13.0.0 lib/gherkin/token_scanner.rb
cucumber-gherkin-12.0.0 lib/gherkin/token_scanner.rb
cucumber-gherkin-11.0.0 lib/gherkin/token_scanner.rb
cucumber-gherkin-10.0.0 lib/gherkin/token_scanner.rb
cucumber-gherkin-9.2.0 lib/gherkin/token_scanner.rb
cucumber-gherkin-9.1.0 lib/gherkin/token_scanner.rb
gherkin-9.0.0 lib/gherkin/token_scanner.rb
honeybadger-4.5.3 vendor/bundle/ruby/2.6.0/gems/gherkin-5.1.0/lib/gherkin/token_scanner.rb
gherkin-8.2.1 lib/gherkin/token_scanner.rb
gherkin-8.2.0 lib/gherkin/token_scanner.rb
gherkin-8.1.1 lib/gherkin/token_scanner.rb
gherkin-8.0.0 lib/gherkin/token_scanner.rb
gherkin-5.1.0 lib/gherkin/token_scanner.rb
gherkin-5.0.0 lib/gherkin/token_scanner.rb
gherkin-4.1.3 lib/gherkin/token_scanner.rb
gherkin-4.1.2 lib/gherkin/token_scanner.rb
gherkin-4.1.1 lib/gherkin/token_scanner.rb
gherkin-4.1.0 lib/gherkin/token_scanner.rb