Sha256: 3c26a70ab10728e3688246f5fb78febc2cbe45d8360880a06ec2eacd24872a78
Contents?: true
Size: 570 Bytes
Versions: 2
Compression:
Stored size: 570 Bytes
Contents
= Anemone == DESCRIPTION Anemone is a web spider framework that can spider a domain and collect useful information about the pages it visits. It is versatile, allowing you to write your own specialized spider tasks quickly and easily. == FEATURES * Multi-threaded design for high performance * Tracks 301 HTTP redirects to understand a page's aliases * Built-in BFS algorithm for determining page depth * Allows exclusion of URLs based on regular expressions == REQUIREMENTS * hpricot == EXAMPLES See the +bin+ directory for several examples of useful Anemone tasks.
Version data entries
2 entries across 2 versions & 2 rubygems
Version | Path |
---|---|
chriskite-anemone-0.0.4 | README.txt |
anemone-0.0.3 | README.txt |