Sha256: 012c30ca3abc155d7fc3d7d44b8a064acd84497c214a246b7d83e0a91a205992

Contents?: true

Size: 839 Bytes

Versions: 4

Compression:

Stored size: 839 Bytes

Contents

#!/usr/bin/env ruby
# Using the Google scraper module to query Google engines on different geographic locations, then work through the google results to update site store
require 'wmap'

def print_usage
	puts "Program to discovery website assets from Google search engines. Usage: googleBot"
end

puts Wmap.banner
print_usage
Log_dir=File.dirname(__FILE__)+'/../logs/'
Wmap.wlog("Execute the command: googleBot","googleBot",Log_dir+"wmap.log")

abort "Incorrect program argument - no argument needed! Proper Usage: googleBot " unless ARGV.length==0

puts "Start the Google search scraper. This may take a while, please be patient ..."
dis=Wmap::GoogleSearchScraper.new
dis.workers
sites=dis.discovered_sites_from_scraper.keys
puts "Update Google search results into the data repository:"
k=Wmap::SiteTracker.instance
k.adds(sites)
k.save!

Version data entries

4 entries across 4 versions & 1 rubygems

Version Path
wmap-2.4.8 bin/googleBot
wmap-2.4.6 bin/googleBot
wmap-2.4.5 bin/googleBot
wmap-2.4.4 bin/googleBot