Auditor

Audit links: checked="checked" <% end %> />

Audit forms: checked="checked" <% end %> />

Audit cookies: checked="checked" <% end %> />

Audit headers: checked="checked" <% end %> />

Cookies to exclude: <%=session['opts']['settings']['exclude_cookies']%>
(Newline separated)

HTTP options

Concurrent HTTP request limit:

HTTP harvest last: checked="checked" <% end %> />

Cookie jar:

User agent:

Authorized by:

Proxy address:

Proxy port:

Proxy username:

Proxy password:

Proxy type:

Custom HTTP headers: <%= format_custom_headers( session['opts']['settings']['custom_headers'] ) %>
(Newline separated)
(header=value)

Crawler options

Exclude rules: <% if session['opts']['settings']['exclude']%><%=session['opts']['settings']['exclude'].join( "\r\n" )%><%end%>
(Newline separated)

Include rules: <% if session['opts']['settings']['include']%><%=session['opts']['settings']['include'].join( "\r\n" )%><%end%>
(Newline separated)

Redundant rules: <%=format_redundants( session['opts']['settings']['redundant'] )%>
(Newline separated)
(regexp:counter)

Depth:
(Default: infinite)

Link count limit:
(Default: infinite)

Redirect limit:
(Default: infinite)

Follow subdomain: checked="checked" <% end %> />

Obey robot.txt file: checked="checked" <% end %> />

Extend paths:
(Newline separated)

Restrict paths:
(Newline separated)

Settings