008: 008 abacho_bot: ABACHOBot accoona_ai_agent: Accoona-AI-Agent add_sugar_spider_bot: AddSugarSpiderBot any_apex_bot: AnyApexBot arachmo: Arachmo blitzbot: B-l-i-t-z-B-O-T baiduspider: Baiduspider become_bot: BecomeBot beslist_bot: BeslistBot billy_bob_bot: BillyBobBot bimbot: Bimbot bingbot: Bingbot blitz_bot: BlitzBOT boitho_com_dc: boitho.com-dc boitho_com_robot: boitho.com-robot btbot: btbot catch_bot: CatchBot cerberian_drtrs: Cerberian Drtrs charlotte: Charlotte convera_crawler: ConveraCrawler cosmos: cosmos covario_ids: Covario IDS datapark_search: DataparkSearch diamond_bot: DiamondBot discobot: Discobot dotbot: Dotbot emerald_shield_com_web_bot: EmeraldShield.com WebBot envolk_its_spider: envolk[ITS]spider esperanza_bot: EsperanzaBot exabot: Exabot fast_enterprise_crawler: FAST Enterprise Crawler fast_web_crawler: FAST-WebCrawler fdse_robot: FDSE robot find_links: FindLinks furl_bot: FurlBot fyber_spider: FyberSpider g2crawler: g2crawler gaisbot: Gaisbot galaxy_bot: GalaxyBot genie_bot: genieBot gigabot: Gigabot girafabot: Girafabot googlebot: Googlebot googlebot_image: Googlebot-Image guruji_bot: GurujiBot happy_fun_bot: HappyFunBot hl_ftien_spider: hl_ftien_spider holmes: Holmes htdig: htdig iaskspider: iaskspider ia_archiver: ia_archiver ic_crawler: iCCrawler ichiro: ichiro igde_spyder: igdeSpyder irl_bot: IRLbot issue_crawler: IssueCrawler jaxified_bot: Jaxified Bot jyxobot: Jyxobot koepa_bot: KoepaBot l_webis: L.webis lapozz_bot: LapozzBot larbin: Larbin ld_spider: LDSpider lexxe_bot: LexxeBot linguee_bot: Linguee Bot link_walker: LinkWalker lmspider: lmspider lwp_trivial: lwp-trivial mabontland: mabontland magpie_crawler: magpie-crawler mediapartners_google: Mediapartners-Google mj12bot: MJ12bot mnogosearch: Mnogosearch mogimogi: mogimogi mojeek_bot: MojeekBot moreoverbot: Moreoverbot morning_paper: Morning Paper msnbot: msnbot msr_bot: MSRBot mva_client: MVAClient mxbot: mxbot net_research_server: NetResearchServer net_seer_crawler: NetSeer Crawler news_gator: NewsGator ng_search: NG-Search nicebot: nicebot noxtrumbot: noxtrumbot nusearch_spider: Nusearch Spider nutch_cvs: NutchCVS nymesis: Nymesis obot: obot oegp: oegp omgilibot: omgilibot omni_explorer_bot: OmniExplorer_Bot oozbot: OOZBOT orbiter: Orbiter page_bites_hyper_bot: PageBitesHyperBot peew: Peew polybot: polybot pompos: Pompos post_post: PostPost psbot: Psbot pyc_url: PycURL qseero: Qseero radian6: Radian6 rampy_bot: RAMPyBot rufus_bot: RufusBot sand_crawler: SandCrawler sb_ider: SBIder scout_jet: ScoutJet scrubby: Scrubby search_sight: SearchSight seekbot: Seekbot semanticdiscovery: semanticdiscovery sensis_web_crawler: Sensis Web Crawler seo_chat_bot: SEOChat::Bot seznam_bot: SeznamBot shim_crawler: Shim-Crawler shop_wiki: ShopWiki shoula_robot: Shoula robot silk: silk sitebot: Sitebot snappy: Snappy sogou_spider: sogou spider sosospider: Sosospider speedy_spider: Speedy Spider sqworm: Sqworm stack_rambler: StackRambler suggybot: suggybot survey_bot: SurveyBot synoo_bot: SynooBot teoma: Teoma terrawiz_bot: TerrawizBot the_su_bot: TheSuBot thumbnail_cz_robot: Thumbnail.CZ robot tin_eye: TinEye truwo_gps: truwoGPS turnitin_bot: TurnitinBot tweeted_times_bot: TweetedTimes Bot twenga_bot: TwengaBot updated: updated urlfilebot: Urlfilebot vagabondo: Vagabondo voila_bot: VoilaBot vortex: Vortex voyager: voyager vyu2: VYU2 webcollage: webcollage websquash_com: Websquash.com wf84: wf84 wo_finde_ich_robot: WoFindeIch Robot womlpe_factory: WomlpeFactory xaldon_web_spider: Xaldon_WebSpider yacy: yacy yahoo_slurp: Yahoo! Slurp yahoo_slurp_china: Yahoo! Slurp China yahoo_seeker: YahooSeeker yahoo_seeker_testing: YahooSeeker-Testing yandex_bot: YandexBot yandex_images: YandexImages yasaklibot: Yasaklibot yeti: Yeti yodao_bot: YodaoBot yoogli_fetch_agent: yoogliFetchAgent youdao_bot: YoudaoBot zao: Zao zealbot: Zealbot zspider: zspider zy_borg: ZyBorg