Sha256: 3af5bb384011089867713dded8456a8726213ca57022db7698df00f44b4cf64d

Contents?: true

Size: 381 Bytes

Versions: 17

Compression:

Stored size: 381 Bytes

Contents

# frozen_string_literal: true
class RobotsTxtServlet < WEBrick::HTTPServlet::AbstractServlet
  def do_GET(req, res)
    if /301/ === req['Host'] && req.path == '/robots.txt'
      res['Location'] = 'http://301/robots_txt'
      res.code = 301
    else
      res['Content-Type'] = 'text/plain'
      res.body = <<-'EOF'
User-Agent: *
Disallow: /norobots
      EOF
    end
  end
end

Version data entries

17 entries across 17 versions & 1 rubygems

Version Path
mechanize-2.14.0 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.13.0 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.12.2 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.12.1 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.12.0 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.11.0 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.10.1 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.10.0 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.9.2 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.9.1 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.9.0 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.8.5 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.8.4 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.8.3 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.8.2 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.8.1 lib/mechanize/test_case/robots_txt_servlet.rb
mechanize-2.8.0 lib/mechanize/test_case/robots_txt_servlet.rb