Contents

require 'mechanize'
require 'uri'

module Scrapers
  def self.agent()
    @agent ||= Mechanize.new
  end

  def self.base_url(url)
    u = URI.parse(url)
    u.path=''
    u.to_s
  end
end

Version data entries

3 entries across 3 versions & 1 rubygems

Version	Path
scrapers-3.2.0	lib/scrapers.rb
scrapers-3.1.0	lib/scrapers.rb
scrapers-3.0.0	lib/scrapers.rb