Sha256: 3c26a70ab10728e3688246f5fb78febc2cbe45d8360880a06ec2eacd24872a78

Contents?: true

Size: 570 Bytes

Versions: 2

Compression:

Stored size: 570 Bytes

Contents

= Anemone

== DESCRIPTION
Anemone is a web spider framework that can spider a domain and collect useful
information about the pages it visits. It is versatile, allowing you to
write your own specialized spider tasks quickly and easily.

== FEATURES
* Multi-threaded design for high performance
* Tracks 301 HTTP redirects to understand a page's aliases
* Built-in BFS algorithm for determining page depth
* Allows exclusion of URLs based on regular expressions

== REQUIREMENTS
* hpricot

== EXAMPLES
See the +bin+ directory for several examples of useful Anemone tasks.

Version data entries

2 entries across 2 versions & 2 rubygems

Version Path
chriskite-anemone-0.0.4 README.txt
anemone-0.0.3 README.txt