Contents

# In this example let's have 3 documents.  2 of the documents 
# will go into our training set and 1 will be used as our 
# test set
#
# Before we can actually classify the documents we need to 
# create integer representations of each of the documents.
# The best way to do this would be to use ruby to accomplish
# the task.
#
require 'libsvm'

# Let take our documents and create word vectors out of them.
# I've included labels for these already.  1 signifies that
# the document was funny, 0 means that it wasn't.
#
documents = [[1, "Why did the chicken cross the road? Because a car was coming"],
             [0, "You're an elevator tech? I bet that job has its ups and downs"]]

# Lets create a dictionary of unique words and then we can
# create our vectors.  This is a very simple example.  If you
# were doing this in a production system you'd do things like
# stemming and removing all punctuation (in a less casual way).
#
dictionary = documents.map(&:last).map(&:split).flatten.uniq
dictionary = dictionary.map { |x| x.gsub(/\?|,|\.|\-/,'') }

training_set = []
documents.each do |doc|
  features_array = dictionary.map { |x| doc.last.include?(x) ? 1 : 0 }
  training_set << [doc.first, Libsvm::Node.features(features_array)]
end

# Lets set up libsvm so that we can test our prediction
# using the test set
#
problem = Libsvm::Problem.new
parameter = Libsvm::SvmParameter.new

parameter.cache_size = 1 # in megabytes
parameter.eps = 0.001
parameter.c   = 10

# Train classifier using training set
#
problem.set_examples(training_set.map(&:first), training_set.map(&:last))
model = Libsvm::Model.train(problem, parameter)

# Now lets test our classifier using the test set
#
test_set = [1, "Why did the chicken cross the road? To get the worm"]
test_document = test_set.last.split.map{ |x| x.gsub(/\?|,|\.|\-/,'') }

doc_features = dictionary.map{|x| test_document.include?(x) ? 1 : 0 }
pred = model.predict(Libsvm::Node.features(doc_features))
puts "Predicted #{pred==1 ? 'funny' : 'not funny'}"

Version data entries

19 entries across 19 versions & 1 rubygems

Version	Path
rb-libsvm-1.4.4	examples/text.rb
rb-libsvm-1.4.3	examples/text.rb
rb-libsvm-1.4.2	examples/text.rb
rb-libsvm-1.4.1	examples/text.rb
rb-libsvm-1.4.0	examples/text.rb
rb-libsvm-1.3.1	examples/text.rb
rb-libsvm-1.3.0	examples/text.rb
rb-libsvm-1.2.0	examples/text.rb
rb-libsvm-1.1.5	examples/text.rb
rb-libsvm-1.1.4	examples/text.rb
rb-libsvm-1.1.3	examples/text.rb
rb-libsvm-1.1.2	examples/text.rb
rb-libsvm-1.1.1	examples/text.rb
rb-libsvm-1.1.0	examples/text.rb
rb-libsvm-1.0.11	examples/text.rb
rb-libsvm-1.0.10	examples/text.rb
rb-libsvm-1.0.9	examples/text.rb
rb-libsvm-1.0.8	examples/text.rb
rb-libsvm-1.0.7	examples/text.rb