# file: robots.txt,v 1.0 2002/09/23 created by hellojan # www.ccf.com.cn # 按照robots.txt的标准写法,规定一些不允许爬虫爬的页面或目录。 # robots.txt 的写法参照 # Format is: # User-agent: # Disallow: | # ----------------------------------------------------------------------------- User-agent: * Disallow: /member/ Disallow: /dynamic_graph/ Disallow: /include/ Disallow: /newscenter/ Disallow: /informs/ Disallow: /supply/ Disallow: /myoffice/ Disallow: /quota/quota.browse.php Disallow: /quota/quota.create.php Disallow: /quota/quota.del.php Disallow: /quota/quota.inc.php Disallow: /quota/quota_login.php Disallow: /quota/quota.modify.php Disallow: /quota/quota.passrtn.php Disallow: /quota/quota.reg.php Disallow: /quota/quota.showindex.php #Disallow: /hrcenter/