Contents

require 'dentaku/token'

module Dentaku
  class TokenScanner
    def initialize(category, regexp, converter=nil)
      @category  = category
      @regexp    = %r{\A(#{ regexp })}
      @converter = converter
    end

    def scan(string)
      if m = @regexp.match(string)
        value = raw = m.to_s
        value = @converter.call(raw) if @converter

        return Token.new(@category, value, raw)
      end

      false
    end
  end
end

Version data entries

5 entries across 5 versions & 1 rubygems

Version	Path
dentaku-0.2.1	lib/dentaku/token_scanner.rb
dentaku-0.1.3	lib/dentaku/token_scanner.rb
dentaku-0.1.2	lib/dentaku/token_scanner.rb
dentaku-0.1.1	lib/dentaku/token_scanner.rb
dentaku-0.1.0	lib/dentaku/token_scanner.rb