Contents

module TextRank
  ##
  # Token filters can be used to pre-process potential tokens prior to creating
  # a graph or executing PageRank.  Filters are typically used to throw out tokens
  # which are not good candidates for keywords.  However, it is possible for a
  # filter to add new tokens or to modify existing ones.
  #
  # Token filters are applied as a chain, so care should be taken to use them
  # in the desired order.
  ##
  module TokenFilter

    autoload :MinLength,    'text_rank/token_filter/min_length'
    autoload :PartOfSpeech, 'text_rank/token_filter/part_of_speech'
    autoload :Stopwords,    'text_rank/token_filter/stopwords'

  end
end

Version data entries

13 entries across 13 versions & 1 rubygems

Version	Path
text_rank-1.3.1	lib/text_rank/token_filter.rb
text_rank-1.3.0	lib/text_rank/token_filter.rb
text_rank-1.2.9	lib/text_rank/token_filter.rb
text_rank-1.2.5	lib/text_rank/token_filter.rb
text_rank-1.2.4	lib/text_rank/token_filter.rb
text_rank-1.2.3	lib/text_rank/token_filter.rb
text_rank-1.2.2	lib/text_rank/token_filter.rb
text_rank-1.2.0	lib/text_rank/token_filter.rb
text_rank-1.1.7	lib/text_rank/token_filter.rb
text_rank-1.1.6	lib/text_rank/token_filter.rb
text_rank-1.1.5	lib/text_rank/token_filter.rb
text_rank-1.1.1	lib/text_rank/token_filter.rb
text_rank-1.1.0	lib/text_rank/token_filter.rb