Sha256: 94e13f3bd717fc61e137386f4fefe39b0f4803f2110df4df70b826900329a2cd

Contents?: true

Size: 357 Bytes

Versions: 6

Compression:

Stored size: 357 Bytes

Contents

# -*- coding: utf-8 -*-
require 'test/unit'
require 'tokenizer'

class TestTokenizerDev < Test::Unit::TestCase

  def setup
    @fr_tokenizer = Tokenizer::Tokenizer.new(:fr)
  end

  def test_tokenization_001
  end

  private
  def compare(exp_result, input)
    act_result = @de_tokenizer.tokenize(input)
    assert_equal(exp_result, act_result)
  end
end

Version data entries

6 entries across 6 versions & 2 rubygems

Version Path
metanorma-cli-1.3.4 gems/ruby/2.6.0/gems/tokenizer-0.3.0/test/development_tests/test_fr_tokenizer_dev.rb
metanorma-cli-1.3.3.1 gems/ruby/2.6.0/gems/tokenizer-0.3.0/test/development_tests/test_fr_tokenizer_dev.rb
tokenizer-0.3.0 test/development_tests/test_fr_tokenizer_dev.rb
tokenizer-0.2.0 test/development_tests/test_fr_tokenizer_dev.rb
tokenizer-0.1.2 test/development_tests/test_fr_tokenizer_dev.rb
tokenizer-0.1.1 test/test_fr_tokenizer_dev.rb