Sha256: 012c30ca3abc155d7fc3d7d44b8a064acd84497c214a246b7d83e0a91a205992
Contents?: true
Size: 839 Bytes
Versions: 4
Compression:
Stored size: 839 Bytes
Contents
#!/usr/bin/env ruby # Using the Google scraper module to query Google engines on different geographic locations, then work through the google results to update site store require 'wmap' def print_usage puts "Program to discovery website assets from Google search engines. Usage: googleBot" end puts Wmap.banner print_usage Log_dir=File.dirname(__FILE__)+'/../logs/' Wmap.wlog("Execute the command: googleBot","googleBot",Log_dir+"wmap.log") abort "Incorrect program argument - no argument needed! Proper Usage: googleBot " unless ARGV.length==0 puts "Start the Google search scraper. This may take a while, please be patient ..." dis=Wmap::GoogleSearchScraper.new dis.workers sites=dis.discovered_sites_from_scraper.keys puts "Update Google search results into the data repository:" k=Wmap::SiteTracker.instance k.adds(sites) k.save!
Version data entries
4 entries across 4 versions & 1 rubygems
Version | Path |
---|---|
wmap-2.4.8 | bin/googleBot |
wmap-2.4.6 | bin/googleBot |
wmap-2.4.5 | bin/googleBot |
wmap-2.4.4 | bin/googleBot |