Log In Sign Up

анти-мошенник.рф
robots.txt

Robots Exclusion Standard data for анти-мошенник.рф

Resource Scan

Scan Details

Site Domain анти-мошенник.рф
Base Domain анти-мошенник.рф
Scan Status Ok
Last Scan2025-10-02T01:40:23+00:00
Next Scan 2025-10-09T01:40:23+00:00

Last Scan

Scanned2025-10-02T01:40:23+00:00
URL https://анти-мошенник.рф/robots.txt
Redirect https://xn----7sbqkcmlfeai8b4e.xn--p1ai/robots.txt
Domain IPs 188.127.230.7
Response IP 188.127.230.7
Found Yes
Hash 99869705408ac5ef47f57f9fea49c0f9e8d15018764f121c7c1cde98cafe1bb6
SimHash 435c187769f2

Groups

linguee

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /user/
Disallow /js/
Disallow /captcha/
Disallow /templates/

Other Records

Field Value
crawl-delay 20
Back to top

Other Records

Field Value
sitemap http://xn----7sbqkcmlfeai8b4e.xn--p1ai/sitemap.xml
Back to top

Comments

  • Отключаем ботов
  • https://seo-robotic.ru/blog/news/disallow-bad-bots/
  • YandexDirect bidswitchbot YandexMetrika SemrushBot http://statdom.ru/bot.html GrapeshotCrawler DotBot bingbot YandexMobileBot MJ12bot
  • Googlebot UptimeRobot BLEXBot YandexBot Mail.RU_Bot AhrefsBot trovitBot aiHitBot
Back to top