下面是以前我的 robots.txt

#
# robots.txt for scavin
# Version 07.09.12
#

Sitemap: http://www.appinn.com/sitemap.xml

User-agent: *
Disallow: /*?p*
Disallow: /cgi-bin/
Disallow: /wp-
Disallow: /comments/feed
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /feed/
Disallow: /trackback/
Disallow: */feed*
Disallow: */trackback
Disallow: /*.php$
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.css$
Disallow: /*.gz$
Disallow: /*.wmv$
Disallow: /*.cgi$

下面是新的 robots.txt

User-agent: *
Disallow: /*/feed/
Disallow: /*/trackback/

来自大牛 Techcrunch

发表评论