Contents

require 'unit_test_helper.rb'
include ActsAsIndexed

class PreTokenizerTest < ActiveSupport::TestCase

  def test_strips_non_word_characters
    assert_equal "Chocolate Chip Cookies ", PreTokenizer.process("Chocolate-Chip Cookies!")
  end

  def test_strips_underscores
    assert_equal "Test try it", PreTokenizer.process("Test_try_it")
  end

end

Version data entries

2 entries across 2 versions & 1 rubygems

Version	Path
acts_as_indexed-0.9.0	test/unit/pre_tokenizer_test.rb
acts_as_indexed-0.8.3	test/unit/pre_tokenizer_test.rb