# This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See # Format is: # User-agent: # Disallow: | # Sites listing Bots by User-agent: # - http://net-promoter.com/robots-txt/spider_list # - http://www.pgts.com.au/pgtsj/pgtsj0208d.html # ----------------------------------------------------------------------------- User-agent: * Disallow: /help Disallow: /icons Disallow: images/*.gif Disallow: images/*.png User-agent: psbot Disallow: /* User-agent: msnbot Disallow: /*.gif