# http://www.aplacetosearch.com/ # -------------------------------- # A Place to Search - Web Directory -- aplacetosearch.com # Please, no more that 1 hit per minute and use off peak hours. # Robot Exclusion File -- robots.txt # Sitemap: http://www.aplacetosearch.com/GoogleMap.xml # Sitemap: http://www.aplacetosearch.com/AtomMap.xml # Sitemap: http://www.aplacetosearch.com/RssMap.xml # Sitemap: http://www.aplacetosearch.com/RssLatest.xml # Sitemap: http://www.aplacetosearch.com/PodCasts.xml # Sitemap: http://www.aplacetosearch.com/urllist.txt # Sitemap: http://www.aplacetosearch.com/sitemap.html # Sitemap: http://www.aplacetosearch.com/sitemap.xml # Author: Alfred Norman # Last Updated: 6/17/08 User-agent: Slurp Disallow: User-agent: googlebot Disallow: User-agent: msnbot Disallow: User-agent: MSNBOT/0.1 (http://search.msn.com/msnbot.htm) Disallow: User-agent: Teoma Disallow: User-agent: Ask Jeeves Disallow: User-agent: Jeeves Disallow: User-agent: ia_archiver Disallow: User-agent: Mozilla/2.0 (compatible; Ask Jeeves/Teoma) Disallow: User-agent: askjeeves Disallow: User-agent: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) Disallow: User-agent: Yahoo! Slurp Disallow: User-agent: Gulliver/1.1 Disallow: User-agent: winona Disallow: User-agent: whatUseek_winona/3.0 Disallow: User-agent: Fluffy the spider (info@searchhippo.com) Disallow: User-agent: speedy Disallow: User-agent: Speedy Spider ( http://www.entireweb.com/speedy.html ) Disallow: User-agent: gulliver Disallow: User-agent: grabber Disallow: User-agent: AESOP_com_SpiderMan Disallow: User-agent: ah-ha.com crawler (crawler@ah-ha.com) Disallow: User-agent: Lycos_Spider_(modspider) Disallow: User-agent: T-Rex Disallow: User-agent: Lycos_Spider_(T-Rex) Disallow: User-agent: Collective Disallow: User-agent: Slurp/2.0 Disallow: User-agent: ahoy Disallow: User-agent: appie Disallow: User-agent: architext Disallow: User-agent: arks Disallow: User-agent: ATN_Worldwide Disallow: User-agent: ArchitextSpider Disallow: User-agent: appie/1.1 Disallow: User-agent: combine Disallow: User-agent: boxseabot Disallow: User-agent: coolbot Disallow: User-agent: christcrawler Disallow: User-agent: CoolBot Disallow: User-agent: cruiser Disallow: User-agent: Internet Cruiser Robot Disallow: User-agent: ahoythehomepagefinder Disallow: User-agent: digger Disallow: User-agent: elfinbot Disallow: User-agent: emcspider Disallow: User-agent: EMC Spider Disallow: User-agent: esther Disallow: User-agent: fastcrawler Disallow: User-agent: fido Disallow: User-agent: KIT-Fireball Disallow: User-agent: fouineur Disallow: User-agent: Freecrawl Disallow: User-agent: funnelweb Disallow: User-agent: hambot Disallow: User-agent: hotwired Disallow: User-agent: INGRID/0.1 Disallow: User-agent: infoseek Disallow: User-agent: InfoSeek Robot 1.0 Disallow: User-agent: infoseeksidewinder Disallow: User-agent: Infoseek Sidewinder Disallow: User-agent: Iron33 Disallow: User-agent: KDD-Explorer Disallow: User-agent: KDD-Explorer/0.1 Disallow: User-agent: Iron33/0.0 Disallow: User-agent: FunnelWeb-1.0 Disallow: User-agent: KIT-Fireball/2.0 libwww/5.0a Disallow: User-agent: fido/0.9 Harvest/1.4.pl2 Disallow: User-agent: Digger/1.0 JDK/1.3.0 Disallow: User-agent: Mozilla/4.0 (compatible; ChristCrawler.com, ChristCrawler@ChristCENTRAL.com) Disallow: User-agent: BoxSeaBot/0.5 (http://boxsea.com/crawler) Disallow: User-agent: combine/0.0 Disallow: User-agent: LWP Disallow: User-agent: ko_yappo_robot Disallow: User-agent: KO_Yappo_Robot/1.0.4(http://yappo.com/info/robot.html) Disallow: User-agent: LabelGrab/1.1 Disallow: User-agent: label-grabber Disallow: User-agent: legs Disallow: User-agent: Lycos/x.x Disallow: User-agent: lycos Disallow: User-agent: marvin Disallow: User-agent: marvin/infoseek (marvin-team@webseek.de) Disallow: User-agent: udmsearch Disallow: User-agent: UdmSearch Disallow: User-agent: moget Disallow: User-agent: moget/1.0 Disallow: User-agent: MuscatFerret Disallow: User-agent: MuscatFerret/ Disallow: User-agent: NDSpider/1.5 Disallow: User-agent: NDSpider Disallow: User-agent: NetScoop Disallow: User-agent: NetScoop/1.0 libwww/5.0a Disallow: User-agent: Orbsearch/1.0 Disallow: User-agent: pageboy Disallow: User-agent: PageBoy/1.0 Disallow: User-agent: ParaSite Disallow: User-agent: ParaSite/0.21 (http://www.ianett.com/parasite/) Disallow: User-agent: Pimptrain Disallow: User-agent: Mozilla/4.0 (compatible: Pimptrain's robot) Disallow: User-agent: pjspider Disallow: User-agent: PortalJuice.com/4.0 Disallow: User-agent: psbot Disallow: User-agent: psbot/0.X (+http://www.picsearch.com/bot.html) Disallow: User-agent: Raven Disallow: User-agent: Raven-v2 Disallow: User-agent: robi Disallow: User-agent: ComputingSite Robi/1.0 (robi@computingsite.com) Disallow: User-agent: RoboCrawl Disallow: User-agent: RoboCrawl (http://www.canadiancontent.net) Disallow: User-agent: Scooter Disallow: User-agent: Scooter/2.0 G.R.A.B. V1.1.0 Disallow: User-agent: Mozilla/4.0 (Sleek Spider/1.2) Disallow: User-agent: search-info Disallow: User-agent: Shagseeker Disallow: User-agent: Shagseeker at http://www.shagseek.com /1.0 Disallow: User-agent: ESI Disallow: User-agent: ESISmartSpider/2.0 Disallow: User-agent: topiclink Disallow: User-agent: TLSpider/1.1 Disallow: User-agent: 'Ahoy! The Homepage Finder' Disallow: User-agent: FAST-WebCrawler/2.1-pre14 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) Disallow: User-agent: FAST-WebCrawler/2.1-pre11 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) Disallow: User-agent: FAST-WebCrawler/2.1-pre10 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) Disallow: User-agent: FAST-WebCrawler/2.2-pre41 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) Disallow: User-agent: Slurp/2.0-GreatWhiteCrawl (slurp@inktomi.com; http://www.inktomi.com/slurp.html) Disallow: User-agent: Mozilla/3.0 (Slurp/si; slurp@inktomi.com; http://www.inktomi.com/slurp.html) Disallow: User-agent: Slurp.so/1.0 (slurp@inktomi.com; http://www.inktomi.com/slurp.html) Disallow: User-agent: Slurp/2.0-KiteWeekly (slurp@inktomi.com; http://www.inktomi.com/slurp.html) Disallow: User-agent: Slurp/cat (slurp@inktomi.com; http://www.inktomi.com/slurp.html) Disallow: User-agent: Mozilla/5.0 (Slurp/cat; slurp@inktomi.com; http://www.inktomi.com/slurp.html) Disallow: User-agent: Mozilla/3.0 (Slurp.so/Goo; slurp@inktomi.com; http://www.inktomi.com/slurp.html) Disallow: User-agent: Slurp/si (slurp@inktomi.com; http://www.inktomi.com/slurp.html) Disallow: User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /help/ Disallow: /support/ Disallow: /entropybanner/ Disallow: /jobsearch/ Disallow: /store/ Disallow: /store1/ Disallow: /backup/ Disallow: /vpchat/