Sha256: 4aea110d37689b4f06f1d5f0b13980cc0d1856519eb0e396f5f86607c5871562
Contents?: true
Size: 587 Bytes
Versions: 2
Compression:
Stored size: 587 Bytes
Contents
= Anemone == DESCRIPTION Anemone is a web spider framework that can spider a domain and collect useful information about the pages it visits. It is versatile, allowing you to write your own specialized spider tasks quickly and easily. == FEATURES * Multi-threaded design for high performance * Tracks 301 HTTP redirects to understand a page's aliases * Built-in BFS algorithm for determining page depth * Allows exclusion of URLs based on regular expressions == REQUIREMENTS * hpricot == EXAMPLES See the +bin+ directory for several examples of useful Anemone tasks.
Version data entries
2 entries across 2 versions & 1 rubygems
Version | Path |
---|---|
anemone-0.0.1 | README.txt |
anemone-0.0.2 | README.txt |