Contents

# frozen_string_literal: true

require_relative "tiktoken/version"
require "roseflow/tiktoken/tokenizer"

module Roseflow
  module Tiktoken
    class Error < StandardError; end
    class NoEncodingError < StandardError; end
  end
end

Version data entries

2 entries across 2 versions & 1 rubygems

Version	Path
roseflow-tiktoken-0.2.0	lib/roseflow/tiktoken.rb
roseflow-tiktoken-0.1.0	lib/roseflow/tiktoken.rb