.\" Generated by kramdown-man 1.0.1
.\" https://github.com/postmodern/kramdown-man#readme
.TH ronin-web-new-spider 1 "May 2022" Ronin "User Manuals"
.SH SYNOPSIS
.PP
\fBronin\-web new spider\fR \[lB]\fIoptions\fP\[rB] \[lC]\fB\-\-host\fR\[lB]\fB\[eq]\fR\fIHOST\fP\[rB] \[or] \fB\-\-domain\fR\[lB]\fB\[eq]\fR\fIDOMAIN\fP\[rB] \[or] \fB\-\-site\fR\[lB]\fB\[eq]\fR\fIURL\fP\[rB]\[rC] \[lB]\fIFILE\fP\[rB]
.SH DESCRIPTION
.PP
Generates a new spider Ruby script\.
.SH ARGUMENTS
.TP
\fIFILE\fP
The file to create\.
.SH OPTIONS
.TP
\fB\-\-host\fR\[lB]\fB\[eq]\fR\fIHOST\fP\[rB]
Spiders a host\.
.TP
\fB\-\-domain\fR\[lB]\fB\[eq]\fR\fIDOMAIN\fP\[rB]
Spiders a domain\.
.TP
\fB\-\-site\fR\[lB]\fB\[eq]\fR\fIURL\fP\[rB]
Spiders a site\.
.TP
\fB\-\-every\-link\fR
Adds a callback for every link\.
.TP
\fB\-\-every\-url\fR
Adds a callback for every URL\.
.TP
\fB\-\-every\-failed\-url\fR
Adds a callback for every failed URL\.
.TP
\fB\-\-every\-url\-like\fR \fB\[sl]\fR\fIREGEXP\fP\fB\[sl]\fR
Adds a callback for every URL that matches the regexp\.
.TP
\fB\-\-all\-headers\fR
Adds a callback for all HTTP Headers\.
.TP
\fB\-\-every\-page\fR
Adds a callback for every page\.
.TP
\fB\-\-every\-ok\-page\fR
Adds a callback for every HTTP 200 page\.
.TP
\fB\-\-every\-redirect\-page\fR
Adds a callback for every redirect page\.
.TP
\fB\-\-every\-timedout\-page\fR
Adds a callback for every timedout page\.
.TP
\fB\-\-every\-bad\-request\-page\fR
Adds a callback for every bad request page\.
.TP
\fB\-\-every\-unauthorized\-page\fR
Adds a callback for every unauthorized page\.
.TP
\fB\-\-every\-forbidden\-page\fR
Adds a callback for every forbidden page\.
.TP
\fB\-\-every\-missing\-page\fR
Adds a callback for every missing page\.
.TP
\fB\-\-every\-internal\-server\-error\-page\fR
Adds a callback for every internal server error page\.
.TP
\fB\-\-every\-txt\-page\fR
Adds a callback for every TXT page\.
.TP
\fB\-\-every\-html\-page\fR
Adds a callback for every HTML page\.
.TP
\fB\-\-every\-xml\-page\fR
Adds a callback for every XML page\.
.TP
\fB\-\-every\-xsl\-page\fR
Adds a callback for every XSL page\.
.TP
\fB\-\-every\-javascript\-page\fR
Adds a callback for every JavaScript page\.
.TP
\fB\-\-every\-css\-page\fR
Adds a callback for every CSS page\.
.TP
\fB\-\-every\-rss\-page\fR
Adds a callback for every RSS page\.
.TP
\fB\-\-every\-atom\-page\fR
Adds a callback for every Atom page\.
.TP
\fB\-\-every\-ms\-word\-page\fR
Adds a callback for every MS Wod page\.
.TP
\fB\-\-every\-pdf\-page\fR
Adds a callback for every PDF page\.
.TP
\fB\-\-every\-zip\-page\fR
Adds a callback for every ZIP page\.
.TP
\fB\-\-every\-doc\fR
Adds a callback for every HTML\[sl]XML document\.
.TP
\fB\-\-every\-html\-doc\fR
Adds a callback for every HTML document\.
.TP
\fB\-\-every\-xml\-doc\fR
Adds a callback for every XML document\.
.TP
\fB\-\-every\-xsl\-doc\fR
Adds a callback for every XSL document\.
.TP
\fB\-\-every\-rss\-doc\fR
Adds a callback for every RSS document\.
.TP
\fB\-\-every\-atom\-doc\fR
Adds a callback for every Atom document\.
.TP
\fB\-h\fR, \fB\-\-help\fR
Print help information
.SH AUTHOR
.PP
Postmodern 
.MT postmodern\.mod3\[at]gmail\.com
.ME
.SH SEE ALSO
.PP
.BR ronin\-web\-new\-nokogiri (1)
.BR ronin\-web\-new\-server (1)
.BR ronin\-web\-new\-app (1)