Sha256: 55529ffcc7829b8b9d8bd0e0abff63a9624566e231c8ffb0e8ef833b3f0d5757
Contents?: true
Size: 708 Bytes
Versions: 6
Compression:
Stored size: 708 Bytes
Contents
# Allow access to the whole site disallow :none # Examples: # # Disallow everything: # # disallow :all # # Disallow everything inside /admin: # # disallow_tree admin_path # # For Googlebot: # # googlebot do # disallow login_path # end # # For Bingbot: # # bingbot do # disallow some_path # end # # Custom user agent: # # user_agent "My Custom User Agent" do # disallow some_path # end # # Same rules for multiple user agents: # # user_agent [:googlebot, :bingbot, "My Custom User Agent"] do # disallow some_path # end # # Please see the readme (https://github.com/lassebunk/human_power/blob/master/README.md) # for details on the built-in user agents/crawlers.
Version data entries
6 entries across 6 versions & 1 rubygems