# This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See # # The webmaster for this site is # # Format is: # User-agent: # Disallow: | # ----------------------------------------------------------------------------- User-agent: * Disallow: /counter Disallow: /download Disallow: /log Disallow: /ST Disallow: /QuickPlace Disallow: /mail Disallow: /help Disallow: /admin Disallow: /iNotes Disallow: /webapp Disallow: /formulare.nsf Disallow: /icons Disallow: /stats User-agent: psbot Disallow: /* User-agent: msnbot Disallow: /*.gif User-agent: baiduspider Disallow: / User-agent: thesubot Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler disallow: / User-agent: NPBot Disallow: /