Здравствуйте! Пытаюсь составить правильный robots.txt, для сайта на ДЛЕ 9.2, друг посоветовал использовать робот такого типа:
Что скажете?
| Код |
|---|
User-agent: * Disallow: /*print Disallow: /backup/ Disallow: /2012/ Disallow: /tags/ Disallow: /user/ Disallow: /engine/ Disallow: /favorites/ Disallow: /lastnews/ Disallow: /newposts/ Disallow: /catalog/ Disallow: /statistics.html Disallow: /rules.html Disallow: /addnews.html Disallow: /admin.php Disallow: /go?* Disallow: /?do=tags Disallow: /index.php* Disallow: /*do=lastcomments Disallow: /*subaction=userinfo Disallow: /statistics.html Disallow: /*subaction=newposts Disallow: /*do=feedback Disallow: /*do=register Disallow: /*do=lostpassword Disallow: /*do=addnews Disallow: /*do=stats Disallow: /*do=pm Disallow: /page/ User-agent: Yandex Disallow: /*print Disallow: /backup/ Disallow: /2012/ Disallow: /tags/ Disallow: /user/ Disallow: /engine/ Disallow: /favorites/ Disallow: /lastnews/ Disallow: /newposts/ Disallow: /catalog/ Disallow: /statistics.html Disallow: /rules.html Disallow: /addnews.html Disallow: /admin.php Disallow: /go?* Disallow: /?do=tags Disallow: /index.php* Disallow: /*do=lastcomments Disallow: /*subaction=userinfo Disallow: /statistics.html Disallow: /*subaction=newposts Disallow: /*do=feedback Disallow: /*do=register Disallow: /*do=lostpassword Disallow: /*do=addnews Disallow: /*do=stats Disallow: /*do=pm Disallow: /page/ Sitemap: http:/sit/sitemap.xml Host: site.net |
Что скажете?
