User-agent: * Disallow: /_baks/ Disallow: /_mm/ Disallow: /_notes/ Disallow: /MMWIP/ Disallow: *.csi Disallow: *.htx Disallow: *.idq Disallow: *.txt Disallow: *.config Disallow: *.old Disallow: *.sln Disallow: *.scc Disallow: *.suo Disallow: *.vssscc User-agent: googlebot Disallow: *.csi Disallow: *.htx Disallow: *.idq Disallow: *.txt Disallow: *.config Disallow: *.old Disallow: *.sln Disallow: *.scc Disallow: *.suo Disallow: *.vssscc Disallow: /? User-agent: MSNBOT Disallow: *.csi Disallow: *.htx Disallow: *.idq Disallow: *.txt Disallow: *.config Disallow: *.old Disallow: *.sln Disallow: *.scc Disallow: *.suo Disallow: *.vssscc Disallow: /.?$ User-agent: SLurp Disallow: *.csi Disallow: *.htx Disallow: *.idq Disallow: *.txt Disallow: *.config Disallow: *.old Disallow: *.sln Disallow: *.scc Disallow: *.suo Disallow: *.vssscc Disallow: /.?$ User-agent: Googlebot-Image Disallow: *.csi Disallow: *.htx Disallow: *.idq Disallow: *.txt Disallow: *.config Disallow: *.old Disallow: *.sln Disallow: *.scc Disallow: *.suo Disallow: *.vssscc User-agent: Teoma Disallow: *.csi Disallow: *.htx Disallow: *.idq Disallow: *.txt Disallow: *.config Disallow: *.old Disallow: *.sln Disallow: *.scc Disallow: *.suo Disallow: *.vssscc User-agent: Gigabot Disallow: *.csi Disallow: *.htx Disallow: *.idq Disallow: *.txt Disallow: *.config Disallow: *.old Disallow: *.sln Disallow: *.scc Disallow: *.suo Disallow: *.vssscc User-agent: Scrubby Disallow: *.csi Disallow: *.htx Disallow: *.idq Disallow: *.txt Disallow: *.config Disallow: *.old Disallow: *.sln Disallow: *.scc Disallow: *.suo Disallow: *.vssscc User-agent: Robozilla Disallow: *.csi Disallow: *.htx Disallow: *.idq Disallow: *.txt Disallow: *.config Disallow: *.old Disallow: *.sln Disallow: *.scc Disallow: *.suo Disallow: *.vssscc User-agent: ia_archiver Disallow: *.csi Disallow: *.htx Disallow: *.idq Disallow: *.txt Disallow: *.config Disallow: *.old Disallow: *.sln Disallow: *.scc Disallow: *.suo Disallow: *.vssscc User-agent: yahoo-mmcrawler Disallow: *.csi Disallow: *.htx Disallow: *.idq Disallow: *.txt Disallow: *.config Disallow: *.old Disallow: *.sln Disallow: *.scc Disallow: *.suo Disallow: *.vssscc User-agent: psbot Disallow: *.csi Disallow: *.htx Disallow: *.idq Disallow: *.txt Disallow: *.config Disallow: *.old Disallow: *.sln Disallow: *.scc Disallow: *.suo Disallow: *.vssscc User-agent: yahoo-blogs/v3.9 Disallow: *.csi Disallow: *.htx Disallow: *.idq Disallow: *.txt Disallow: *.config Disallow: *.old Disallow: *.sln Disallow: *.scc Disallow: *.suo Disallow: *.vssscc User-agent: "Mozilla/4.08 [en] (Win98; U ;Nav)" [Spaces are not mistakes]Help->About: "Version 4.08 [en]-98306" Disallow: / User-agent: 8484 Boston Project v 1.0 Disallow: / User-agent: AmiTCP Miami (AmigaOS 2.04) Disallow: / User-agent: Anonymizer/1.1 Disallow: / User-agent: AnswerChase PROve x.0 Disallow: / User-agent: AnswerChase x.0 Disallow: / User-agent: asterias Disallow: / User-agent: Atomic_Email_Hunter/4.0 Disallow: / User-agent: atSpider/1.0 Disallow: / User-agent: autoemailspider Disallow: / User-agent: AVSearch-2.0-fusionIdx-14-CompetitorWebSites Disallow: / User-agent: BackDoorBot/1.0 Disallow: / User-agent: bCentral Billing Post-Process Disallow: / User-agent: Black Hole Disallow: / User-agent: BlackWidow Disallow: / User-agent: BlowFish/1.0 Disallow: / User-agent: BMCLIENT Disallow: / User-agent: Bot mailto:craftbot@yahoo.com Disallow: / User-agent: BotALot Disallow: / User-agent: BuiltBotTough Disallow: / User-agent: Bullseye/1.0 Disallow: / User-agent: BunnySlippers Disallow: / User-agent: bwh3_user_agent Disallow: / User-agent: CamelHttpStream/1.0 Disallow: / User-agent: Cancer Information and Support International; Disallow: / User-agent: Cegbfeieh Disallow: / User-agent: CFNetwork/x.x Disallow: / User-agent: CheckUrl Disallow: / User-agent: CheeseBot Disallow: / User-agent: CherryPicker Disallow: / User-agent: CherryPicker /1.0 Disallow: / User-agent: CherryPickerElite/1.0 Disallow: / User-agent: CherryPickerSE/1.0 Disallow: / User-agent: Chilkat/1.0.0 (+http://www.chilkatsoft.com/ChilkatHttpUA.asp) Disallow: / User-agent: China Local Browse 2.6 Disallow: / User-agent: ChinaClaw Disallow: / User-agent: CHttpClient by Open Text Corporation Disallow: / User-agent: Contact Disallow: / User-agent: ContactBot/0.2 Disallow: / User-agent: ContentSmartz Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: cosmos Disallow: / User-agent: Crawler Disallow: / User-agent: Crescent Disallow: / User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: Custo Disallow: / User-agent: Dart Communications PowerTCP Disallow: / User-agent: DataCha0s/2.0 Disallow: / User-agent: DBrowse 1.4b Disallow: / User-agent: DBrowse 1.4d Disallow: / User-agent: dds explorer v1.0 beta Disallow: / User-agent: Demo Bot DOT 16b Disallow: / User-agent: Demo Bot Z 16b Disallow: / User-agent: DevComponents.com HtmlDocument Object Disallow: / User-agent: DISCo Disallow: / User-agent: DiscoPump Disallow: / User-agent: DittoSpyder Disallow: / User-agent: Doubanbot/1.0 (bot@douban.com http://www.douban.com) Disallow: / User-agent: Dr.Web (R) online scanner: http://online.drweb.com/ Disallow: / User-agent: DSurf15a 01 Disallow: / User-agent: DSurf15a 71 Disallow: / User-agent: DSurf15a 81 Disallow: / User-agent: DSurf15a VA Disallow: / User-agent: EBrowse 1.4b Disallow: / User-agent: Educate Search VxB Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: EmailWolf 1.00 Disallow: / User-agent: EroCrawler Disallow: / User-agent: ESurf15a 15 Disallow: / User-agent: ExtractorPro Disallow: / User-agent: fly/6.01 libwww/4.0D Disallow: / User-agent: Foobot Disallow: / User-agent: Franklin Locator 1.8 Disallow: / User-agent: FSurf15a 01 Disallow: / User-agent: Full Web Bot 0416B Disallow: / User-agent: Full Web Bot 0516B Disallow: / User-agent: Full Web Bot 2816B Disallow: / User-agent: geckobot Disallow: / User-agent: GeoBot/1.0 Disallow: / User-agent: googlebot (larbin2.6.0@unspecified.mail) Disallow: / User-agent: Guestbook Auto Submitter Disallow: / User-agent: Harvest/1.5 Disallow: / User-agent: hgrepurl/1.0 Disallow: / User-agent: hloader Disallow: / User-agent: httplib Disallow: / User-agent: HTTrack Disallow: / User-agent: HTTrack/3.0x Disallow: / User-agent: humanlinks Disallow: / User-agent: Hybrid/1.2 [en] (OS Independent) Disallow: / User-agent: iaskspider Disallow: / User-agent: iearthworm/1.0, iearthworm@yahoo.com.cn Disallow: / User-agent: Incutio HttpClient v0.x Disallow: / User-agent: Industry Program 1.0.x Disallow: / User-agent: InetURL/1.0 Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: InternetSeer Disallow: / User-agent: IP*Works! V5 HTTP/S Component - by /n software - www.nsoftware.com Disallow: / User-agent: IrssiUrlLog/0.2 Disallow: / User-agent: ISC Systems iRc Search 2.1 Disallow: / User-agent: IUPUI Research Bot v 1.9a Disallow: / User-agent: Java 1.1 Disallow: / User-agent: Java1.1.xx.x Disallow: / User-agent: Java1.3.0rc1 Disallow: / User-agent: Java1.3.x Disallow: / User-agent: JDK/1.1 Disallow: / User-agent: JennyBot Disallow: / User-agent: Kenjin Spider Disallow: / User-agent: Keyword Density/0.9 Disallow: / User-agent: lanshanbot/1.0 Disallow: / User-agent: lanshanbot/1.0 (+http://search.msn.com/msnbot.htm) Disallow: / User-agent: LARBIN-EXPERIMENTAL (efp@gmx.net) Disallow: / User-agent: lc/$ROADS::Version libwww-perl/5.00 Disallow: / User-agent: lcabotAccept: */* Disallow: / User-agent: LetsCrawl.com/1.0 +http://letscrawl.com/ Disallow: / User-agent: LexiBot Disallow: / User-agent: libWeb/clsHTTP Disallow: / User-agent: Lincoln State Web Browser Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: LinkScan/8.1a Unix Disallow: / User-agent: LinkWalker Disallow: / User-agent: LMQueueBot/0.2 Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: LotusDiscovery/x.0 (compatible; Mozilla 4.0; MSIE 4.01; Windows NT) Disallow: / User-agent: LWP::Simple/5.803 Disallow: / User-agent: lwp-trivial Disallow: / User-agent: lwp-trivial/1.34 Disallow: / User-agent: Mac Finder 1.0.xx Disallow: / User-agent: Mag-Net Disallow: / User-agent: Mata Hari Disallow: / User-agent: McBot/5.001 (windows; U; NT4.0; en-us) Disallow: / User-agent: MFC Foundation Class Library 4.0 Disallow: / User-agent: MFC_Tear_Sample Disallow: / User-agent: Microsoft URL Control - 5.01.4511 Disallow: / User-agent: Microsoft URL Control - 6.00.8169 Disallow: / User-agent: Microsoft URL Control - 6.00.8xxx Disallow: / User-agent: MIIxpc Disallow: / User-agent: MIIxpc/4.2 Disallow: / User-agent: minibot Disallow: / User-agent: MiracleAlphaTest Disallow: / User-agent: Missauga Locate 1.0.0 Disallow: / User-agent: Missigua Locator 1.9 Disallow: / User-agent: Missouri College Browse Disallow: / User-agent: Mister PiX Disallow: / User-agent: Mizzu Labs 2.2 Disallow: / User-agent: Mo College 1.9 Disallow: / User-agent: moget Disallow: / User-agent: moget/2.1 Disallow: / User-agent: Mozi! Disallow: / User-agent: Mozilla Disallow: / User-agent: Mozilla (libwhisker/2.4) Disallow: / User-agent: Mozilla/2.0 (compatible; NEWT ActiveX; Win32) Disallow: / User-agent: Mozilla/3.0 (compatible) Disallow: / User-agent: Mozilla/3.0 (compatible; Indy Library) Disallow: / User-agent: Mozilla/3.0 (compatible; scan4mail (advanced version) http://www.peterspages.net/?scan4mail) Disallow: / User-agent: Mozilla/4.0 (compatible; Advanced Email Extractor v2.xx) Disallow: / User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95) Disallow: / User-agent: Mozilla/4.0 (compatible; Iplexx Spider/1.0 http://www.iplexx.at) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; Site Server 3.0 Robot) WebQuest Designs Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 4.0 Robot) Microsoft Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt; DTS Agent Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows 95; Transmission Segment; Hotbar 2.0) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; T312461) RPT-HTTPClient/0.3-3E Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) (dns_admin@c-a-s-h.com) Disallow: / User-agent: Mozilla/4.0 (compatible; Win32; WinHttp.WinHttpRequest.5) Disallow: / User-agent: Mozilla/4.0 (hhjhj@yahoo.com) Disallow: / User-agent: Mozilla/4.0 efp@gmx.net Disallow: / User-agent: Mozilla/4.5+(compatible;+HTTrack+3.0x;+Windows+98) Disallow: / User-agent: Mozilla/4.7 [en]C-CCK-MCD {Yahoo;YIP052400} (Win95; I) Disallow: / User-agent: mozilla/5 Disallow: / User-agent: Mozilla/5.0 (compatible; iaskspider/1.0; MSIE 6.0) Disallow: / User-agent: Mozilla/5.0 (research@mediatrec.com) Disallow: / User-agent: Mozilla/5.0 (Version: xxxx Type:xx) Disallow: / User-agent: MSIE-5.13 (larbin@unspecified.mail) Disallow: / User-agent: MVAClient Disallow: / User-agent: My WinHTTP Connection Disallow: / User-agent: myDaemon Disallow: / User-agent: NameOfAgent (CMS Spider) Disallow: / User-agent: NASA Search 1.0 Disallow: / User-agent: NEC-Hayek/1.0 Disallow: / User-agent: NetAnts Disallow: / User-agent: NetMechanic Disallow: / User-agent: NeuralBot/0.2 Disallow: / User-agent: newsearchengine (ThisUser@unspecified.mail) Disallow: / User-agent: nicebot Disallow: / User-agent: NICErsPRO Disallow: / User-agent: Nocilla/1.0 Disallow: / User-agent: Nsauditor/1.x Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Openfind Disallow: / User-agent: Openfind data gathere Disallow: / User-agent: Opera/6.01 (larbin@unspecified.mail) Disallow: / User-agent: OutfoxBot/0.x (For internet experiments; http://; outfox.agent@gmail.com) Disallow: / User-agent: OutfoxMelonBot/0.5 (for internet experiments; http://; outfoxbot@gmail.com) Disallow: / User-agent: OWR_Crawler 0.1 Disallow: / User-agent: PBrowse 1.4b Disallow: / User-agent: PEAR HTTP_Request class ( http://pear.php.net/ ) Disallow: / User-agent: PeopleChat/Search_Engine Disallow: / User-agent: PEval 1.4b Disallow: / User-agent: PHP/3.x.xx Disallow: / User-agent: PHP/4.0.4pl1 Disallow: / User-agent: PHP/4.1.2 Disallow: / User-agent: plinki/0.1 (you got plinked! (thats a good thing..); http://www.plinki.com; crawl@plinki.com) Disallow: / User-agent: Pockey Disallow: / User-agent: POE-Component-Client-HTTP/0.64 (perl; N; POE; en; rv:0.640000) Disallow: / User-agent: Poirot Disallow: / User-agent: Port Huron Labs Disallow: / User-agent: Production Bot 0116B Disallow: / User-agent: Production Bot 2016B Disallow: / User-agent: Production Bot DOT 3016B Disallow: / User-agent: Program Shareware 1.0.2 Disallow: / User-agent: Progressive Download Disallow: / User-agent: Progressive Download HTTP check Disallow: / User-agent: ProPowerBot/2.14 Disallow: / User-agent: ProWebWalker Disallow: / User-agent: PSurf15a 11 Disallow: / User-agent: PSurf15a 51 Disallow: / User-agent: PSurf15a VA Disallow: / User-agent: psycheclone Disallow: / User-agent: QueryN Metasearch Disallow: / User-agent: Rainbot1.1 Disallow: / User-agent: REBOL Core 2.x.x.x.x Disallow: / User-agent: RepoMonkey Disallow: / User-agent: RepoMonkey Bait & Tackle/v1.01 Disallow: / User-agent: RMA Disallow: / User-agent: RSurf15a 41 Disallow: / User-agent: RSurf15a 51 Disallow: / User-agent: RSurf15a 81 Disallow: / User-agent: Rumours-Agent Disallow: / User-agent: searchbot admin@google.com Disallow: / User-agent: ShablastBot 1.0 Disallow: / User-agent: SiteSnagger Disallow: / User-agent: sna-0.0.1 (mikemuzio@msn.com) Disallow: / User-agent: sna-0.0.1 mikeelliott@hotmail.com Disallow: / User-agent: snap.com beta crawler v0 Disallow: / User-agent: Snapbot/1.0 Disallow: / User-agent: Snapbot/1.0 (Snap Shots, +http://www.snap.com) Disallow: / User-agent: SnoopRob/x.x Disallow: / User-agent: Snoopy v1.xx Disallow: / User-agent: Snoopy v1.xx- : User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MyIE2) Disallow: / User-agent: Snoopy_v0.xx Disallow: / User-agent: sogou develop spider Disallow: / User-agent: Sogou Orion spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07) Disallow: / User-agent: sogou spider Disallow: / User-agent: Sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07) Disallow: / User-agent: sohu agent Disallow: / User-agent: SpankBot Disallow: / User-agent: spanner Disallow: / User-agent: Sqworm/2.9.89-BETA (beta_release; 20020130-839; i686-pc-linux-gnu) Disallow: / User-agent: SSurf15a 11 Disallow: / User-agent: suzuran Disallow: / User-agent: swbot/0.9c libwww/5.3.1 Disallow: / User-agent: SyncBot Disallow: / User-agent: Szukacz/1.4 Disallow: / User-agent: Tagyu Agent/1.0 Disallow: / User-agent: TE Disallow: / User-agent: TeamSoft WinInet Component Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: Telesoft Disallow: / User-agent: The Intraformant Disallow: / User-agent: TheNomad Disallow: / User-agent: TightTwatBot Disallow: / User-agent: Titan Disallow: / User-agent: TJvMultiHttpGrabber Component Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: True_Robot Disallow: / User-agent: True_Robot/1.0 Disallow: / User-agent: TSurf15a 11 Disallow: / User-agent: turingos Disallow: / User-agent: UDM Disallow: / User-agent: Under the Rainbow 2.2 Disallow: / User-agent: URLy Warning Disallow: / User-agent: User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) Disallow: / User-agent: VadixBot Disallow: / User-agent: Vayala|Creep-v0.0.1 (codepoet@wildties.com) Disallow: / User-agent: VayalaCreep-v0.0.1 (haploid@haploid.com) Disallow: / User-agent: VCI Disallow: / User-agent: VCI WebViewer VCI WebViewer Win32 Disallow: / User-agent: Web Image Collector Disallow: / User-agent: WebAuto Disallow: / User-agent: WebBandit Disallow: / User-agent: WebBandit/3.50 Disallow: / User-agent: WebCapture Disallow: / User-agent: WebCopier Disallow: / User-agent: Webdup/0.9 Disallow: / User-agent: Webdupe Disallow: / User-agent: WebEnhancer Disallow: / User-agent: webhack Disallow: / User-agent: WebmasterWorldForumBot Disallow: / User-agent: Web-Robot/5.0 (en-US; web-robot.com/policy.html) Web-Robot Crawler/2.0.3 Disallow: / User-agent: WebSauger Disallow: / User-agent: Website Quester Disallow: / User-agent: Webster Pro Disallow: / User-agent: WebStripper Disallow: / User-agent: WebVulnCrawl.unknown/1.0 libwww-perl/5.803 Disallow: / User-agent: WebZip Disallow: / User-agent: WebZip/4.0 Disallow: / User-agent: Wells Search II Disallow: / User-agent: WEP Search 00 Disallow: / User-agent: Wget Disallow: / User-agent: Wget/1.5.3 Disallow: / User-agent: Wget/1.6 Disallow: / User-agent: WinampMPEG/2.00 (larbin@unspecified.mail) Disallow: / User-agent: WincerSong Agent v1.0 Disallow: / User-agent: www4mail/2.x libwww-FM/2.14 (Unix; I) Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: Xenu's Disallow: / User-agent: Xenu's Link Sleuth 1.1c Disallow: / User-agent: XMLSlurp/0.1 libwww-perl/5.805 Disallow: / User-agent: Zeus Disallow: / User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: / Crawl-delay: 60