Sha256: 6a7d52a9ba33f23c2f8327c47990a2bd1471c039de8a00e142fd0cbd33dc3049
Contents?: true
Size: 581 Bytes
Versions: 3
Compression:
Stored size: 581 Bytes
Contents
= Anemone == DESCRIPTION Anemone is a web spider framework that can spider a domain and collect useful information about the pages it visits. It is versatile, allowing you to write your own specialized spider tasks quickly and easily. == FEATURES * Multi-threaded design for high performance * Tracks 301 HTTP redirects to understand a page's aliases * Built-in BFS algorithm for determining page depth * Allows exclusion of URLs based on regular expressions == REQUIREMENTS * nokogiri * facets == EXAMPLES See the +bin+ directory for several examples of useful Anemone tasks.
Version data entries
3 entries across 3 versions & 2 rubygems
Version | Path |
---|---|
chriskite-anemone-0.0.5 | README.txt |
anemone-0.0.5 | README.rdoc |
anemone-0.0.4 | README.txt |