README.md in ai21-0.2.0 vs README.md in ai21-0.2.1
- old
+ new
@@ -76,9 +76,14 @@
#### Question Answering
```ruby
client.answer("what is the capital of France?", "Capital of France is the city called Paris")
```
+#### Tokenize
+```ruby
+client.tokenize("Lorem ipsum long long tokens!")
+```
+
## Development
After checking out the repo, run `bin/setup` to install dependencies. Then, run `rake spec` to run the tests. You can also run `bin/console` for an interactive prompt that will allow you to experiment.
To install this gem onto your local machine, run `bundle exec rake install`. To release a new version, update the version number in `version.rb`, and then run `bundle exec rake release`, which will create a git tag for the version, push git commits and the created tag, and push the `.gem` file to [rubygems.org](https://rubygems.org).