Log In Sign Up

poehaly.top
robots.txt

Robots Exclusion Standard data for poehaly.top

Resource Scan

Scan Details

Site Domain poehaly.top
Base Domain poehaly.top
Scan Status Ok
Last Scan2025-10-07T23:43:38+00:00
Next Scan 2025-11-06T23:43:38+00:00

Last Scan

Scanned2025-10-07T23:43:38+00:00
URL https://www.poehaly.top/robots.txt
Domain IPs 104.21.25.91, 172.67.133.242, 2606:4700:3031::ac43:85f2, 2606:4700:3033::6815:195b
Response IP 172.67.133.242
Found Yes
Hash 60af5e72d886d30b4bfebda5e92c2fc756967b058643dc79822dfa42a4abd705
SimHash 6918c2e0ce33

Groups

yandex

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /tmp/

Other Records

Field Value
crawl-delay 1

*

Rule Path
Allow /
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://auto-mskm.top/sitemap.xml
sitemap https://auto-mskm.top/sitemap.xml
Back to top

Comments

  • robots.txt — базовый шаблон (Яндекс + универсально)
  • ЗАМЕНИТЕ example.com на ваш домен
  • Игнорируем "мусорные" параметры в URL (Яндекс-специфично)
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top