Sha256: f437fbb14b378a953710f6a32379feeffb8cbe3250f6ee1fe0d97c6f310d3a75
Contents?: true
Size: 1.54 KB
Versions: 1
Compression:
Stored size: 1.54 KB
Contents
# Wriggler Wriggler was created to serve and the crawler for a search engine, moving its way through HTML and/or XML files and grabbing data based on pre determined tags then making/storing the data in a specifically created CSV file. Wriggler acts similarly t0 a spider, but was designed to be used with any number of local files, not as an actual web scraper. ## Installation Add this line to your application's Gemfile: ```ruby gem 'wriggler' ``` And then execute: $ bundle Or install it yourself as: $ gem install wriggler ## Usage You only need to run one command to use Wriggler, run: ```ruby Wriggler.crawl([array, of, HTML/XML, tags], directory) ``` Note: The directory in this should be the top level directory that your HTML/XML files are in. Wriggler will account for any nested directories within this directory that also contain HTML/XML files and at the end of it running will save a new file named "tag_content.csv" to this directory ## Contributing Bug reports and pull requests are welcome on GitHub at https://github.com/[USERNAME]/wriggler. This project is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to the [Contributor Covenant](contributor-covenant.org) code of conduct. On top of that, please contribute. I built this for a very specific reason, but I would very much like to see it become something bigger, so if you can assist with that please do! ## License The gem is available as open source under the terms of the [MIT License](http://opensource.org/licenses/MIT).
Version data entries
1 entries across 1 versions & 1 rubygems
Version | Path |
---|---|
wriggler-1.0.0 | README.md |