Sha256: 4aea110d37689b4f06f1d5f0b13980cc0d1856519eb0e396f5f86607c5871562

Contents?: true

Size: 587 Bytes

Versions: 2

Compression:

Stored size: 587 Bytes

Contents

= Anemone

== DESCRIPTION
Anemone is a web spider framework that can spider a domain and collect useful
information about the pages it visits. It is versatile, allowing you to
write your own specialized spider tasks quickly and easily.

== FEATURES
* Multi-threaded design for high performance
* Tracks 301 HTTP redirects to understand a page's aliases
* Built-in BFS algorithm for determining page depth
* Allows exclusion of URLs based on regular expressions

== REQUIREMENTS
* hpricot

== EXAMPLES
See the +bin+ directory for several examples of useful Anemone tasks.

Version data entries

2 entries across 2 versions & 1 rubygems

Version Path
anemone-0.0.1 README.txt
anemone-0.0.2 README.txt