Sha256: 4c1c8603bd389766e896bee035f767f5f671b81be9b53b61f22311627dca0a8d

Contents?: true

Size: 830 Bytes

Versions: 4

Compression:

Stored size: 830 Bytes

Contents

Cacho
=====

A careless caching client optimized for scraping.

Description
-----------

Cacho is an HTTP client for scraping. It will do most of the things you want
when scraping:

* Follow redirects.
* Set the `User-Agent` to a browser-like string.
* Accept and process gzip encoding.
* Detect when it's been rate limited and wait.
* Retry on silly network errors.
* Use persistent HTTP connections.

Most importantly, Cacho will store responses on disk so that multiple runs of
your script will not hit the endpoints you are scraping. This prevents being
rate limited and also makes your script faster every time.

Usage
-----

    require "cacho"

    client = Cacho.new

    res = client.request(:get, "https://news.ycombinator.com")

Installation
------------

    $ gem install cacho

License
-------

See the `UNLICENSE`.

Version data entries

4 entries across 4 versions & 1 rubygems

Version Path
cacho-0.1.3 README.md
cacho-0.1.2 README.md
cacho-0.1.1 README.md
cacho-0.1.0 README.md