Подскажите, это нормальный робот? Или подредактировать помогите, ели не сложно конечно.
| Цитата |
|---|
|
User-agent: * Disallow: /cgi-bin Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /trackback Disallow: */trackback Disallow: */*/trackback Disallow: */*/feed/*/ Disallow: */feed Disallow: /*?* Disallow: /tag Disallow: */attachment/* Disallow: /page Disallow: */page/ Disallow: /poisk User-agent: YandexBot Disallow: /*id= Disallow: /a/ Disallow: /stat/ Disallow: /index/1 Disallow: /index/2 Disallow: /index/3 Disallow: /index/5 Disallow: /index/7 Disallow: /index/8 Disallow: /index/9 Disallow: /panel/ Disallow: /admin/ Disallow: /secure/ Disallow: /informer/ Disallow: /mchat Disallow: /search Disallow: /shop/order/ Disallow: /?ssid= Disallow: /abnl/ Crawl-delay: 5 Host: megapda.ru/ Allow: / Sitemap: megapda.ru/sitemap_index.xml |
