Вот robots.txt

User-agent: *
Disallow: /autobackup.php
Disallow: /admin.php
Disallow: /user/
Disallow: /cache/
Disallow: /favorites/
Disallow: /cgi-bin/
Disallow: /engine/
Disallow: /language/
Disallow: /templates/
Disallow: /uploads/
Disallow: /backup/
Disallow: /languages/
Disallow: /index.php?do=pm
Disallow: /index.php?do=search
Disallow: /index.php?do=register
Disallow: /index.php?do=feedback
Disallow: /index.php?do=lostpassword
Disallow: /index.php?do=stats
Disallow: /index.php?do=addnews
Disallow: /index.php?subaction=newposts
Disallow: /?do=lastcomments
Disallow: /statistics.html
Sitemap: http://site/sitemap.xml
Host: site.ru


Почему Яндекс исключил эти страници?


/page/3/

/page/4/

/page/5/

/page/6/

/page/7/

/page/70/

/page/8/

/page/9/

/program/page/2/

/program/page/3/

/program/page/4/

/program/page/5/

/program/page/6/

/program/page/7/

/program/page/8/

/2011/06/

/2011/07/01/

/2011/07/02/

/2011/07/04/

/2011/07/05/

/2011/07/06/

/2011/07/09/

/2011/07/10/

/2011/07/11/

/2011/07/12/

/2011/07/13/

/2011/07/14/

/2011/07/15/

/2011/07/16/

/2011/07/16/page/3/

/2011/07/17/

/2011/07/18/

и т.д. и т.п.