User-agent: abot Disallow: / User-agent: AISearchBot Disallow: / User-agent: asterias Disallow: / User-agent: attributor Disallow: / User-agent: baiduspider Disallow: / User-agent: BDFetch Disallow: / User-agent: boitho.com-dc Disallow: / User-agent: Bumblebee Disallow: / User-agent: Bumblebee@relevare.com Disallow: / User-agent: cfetch Disallow: / User-agent: ChangeDetection Disallow: / User-agent: Charlotte Disallow: / User-agent: Collector Disallow: / User-agent: dotbot Disallow: / User-agent: InetWrapper Disallow: / User-agent: InternetSeer Disallow: / User-agent: InternetSeer.com Disallow: / User-agent: JetBot Disallow: / User-agent: JoeDog Disallow: / User-agent: larbin Disallow: / User-agent: LARBIN Disallow: / User-agent: LARBIN-EXPERIMENTAL Disallow: / User-agent: MS Search Disallow: / User-agent: MSIECrawler Disallow: / User-agent: NetMechanic Disallow: / User-agent: NPT Disallow: / User-agent: psbot Disallow: / User-agent: RPT Disallow: / User-agent: RPT-HTTPClient Disallow: / User-agent: Siege Disallow: / User-agent: SURF Disallow: / User-agent: TurnitinBot Disallow: / User-agent: webdup Disallow: / User-agent: WebStripper Disallow: / User-agent: ZyBorg Disallow: / User-agent: aipbot Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: Aport Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: appie Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: BecomeBot Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: booch Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: Bookmark Renewal Check Agent Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: CJNetworkQuality Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: e-SocietyRobot Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: EasyDL Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: Enterprise_Search Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: Exabot-Thumbnails Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: FavOrg Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: Girafa Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: Girafabot Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: heritrix Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: htdig Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: HTTrack Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: ia_archiver Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: ia_archiver-web.archive.org Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: IECheck Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: InetWrapper Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: Java Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: KnowItAll Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: libwww-perl Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: LinkAlarm Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: LinkWalker Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: MAXOMObot Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: Microsoft URL Control Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: NetMechanic Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: nicebot Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: Nutch Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: OmniExplorer_Bot Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: pompos Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: Python-urllib Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: SnapPreviewBot Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: SurveyBot Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: Teleport Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: Teleport Pro Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: Uptimebot Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: WebReaper Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: WebVac Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: Wget Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: Zao Disallow: /to Disallow: /se Disallow: /such Disallow: /di Disallow: /isb Disallow: /au Disallow: /ta Disallow: /buyback/se User-agent: * Disallow: /to Disallow: /se Disallow: /such Disallow: /buyback/se