Sha256: 4c1c8603bd389766e896bee035f767f5f671b81be9b53b61f22311627dca0a8d
Contents?: true
Size: 830 Bytes
Versions: 4
Compression:
Stored size: 830 Bytes
Contents
Cacho ===== A careless caching client optimized for scraping. Description ----------- Cacho is an HTTP client for scraping. It will do most of the things you want when scraping: * Follow redirects. * Set the `User-Agent` to a browser-like string. * Accept and process gzip encoding. * Detect when it's been rate limited and wait. * Retry on silly network errors. * Use persistent HTTP connections. Most importantly, Cacho will store responses on disk so that multiple runs of your script will not hit the endpoints you are scraping. This prevents being rate limited and also makes your script faster every time. Usage ----- require "cacho" client = Cacho.new res = client.request(:get, "https://news.ycombinator.com") Installation ------------ $ gem install cacho License ------- See the `UNLICENSE`.
Version data entries
4 entries across 4 versions & 1 rubygems
Version | Path |
---|---|
cacho-0.1.3 | README.md |
cacho-0.1.2 | README.md |
cacho-0.1.1 | README.md |
cacho-0.1.0 | README.md |