# /robots.txt file for www.interclasse.com # to webwalkers conforming to the defacto standard # . # # Format is: # User-agent: # Disallow: | #----------------------------------------------------------------------------- # User-agent: can also specify by name; "*" is for everyone # Disallow: disallow if this matches first part of requested path # User-agent: * Disallow: /cgi-bin/ # User-agent: Adsbot/3.1 User-agent: AhrefsBot user-agent: Anthill user-agent: AwarioSmartBot User-agent: Barkrowler User-agent: BLEXBot User-agent: CCBot User-agent: digitalshadowsbot User-agent: dotbot User-agent: IonCrawl User-agent: ltx71 - (http://ltx71.com/) User-agent: MauiBot User-agent: MJ12bot User-agent: MTRobot User-agent: Nutch User-agent: oBot User-agent: Riddler User-agent: SafeDNSBot User-agent: SemrushBot User-agent: SurdotlyBot User-Agent: trendictionbot User-agent: YaK User-agent: YaK/1.0 User-Agent: ZoomBot User-agent: Zoominfobot Disallow: /