homesamogon.ru
robots.txt

Robots Exclusion Standard data for homesamogon.ru

Resource Scan

Scan Details

Site Domain homesamogon.ru
Base Domain homesamogon.ru
Scan Status Ok
Last Scan2025-05-05T07:43:11+00:00
Next Scan 2025-05-12T07:43:11+00:00

Last Scan

Scanned2025-05-05T07:43:11+00:00
URL https://homesamogon.ru/robots.txt
Domain IPs 37.140.192.239
Response IP 37.140.192.239
Found Yes
Hash f7ecd3a9f9c1f9fb36e009e871b70847cf68e47abd97c80db39d4853dcb0af8c
SimHash 21555c516293

Groups

yandexbot/3.0

Rule Path
Disallow /

domaincrawler/3.0

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mj12bot/v1.4.8

Rule Path
Disallow /

mj12bot/v1.4.7

Rule Path
Disallow /

odklbot/1.0

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

serpstatbot/2.1

Rule Path
Disallow /

ccbot/2.0

Rule Path
Disallow /

Other Records

Field Value
sitemap https://homesamogon.ru/sitemap.xml

Comments

  • User-agent: *
  • Crawl-delay: 40