User-agent: * Disallow: /admin/ Disallow: /user/ Disallow: /page/ Disallow: /*.js$ Disallow: /*.txt$ Disallow: /index/ User-agent: Baiduspider Disallow: /weblog/