Log In Sign Up

ispaniagid.ru
robots.txt

Robots Exclusion Standard data for ispaniagid.ru

Resource Scan

Scan Details

Site Domain ispaniagid.ru
Base Domain ispaniagid.ru
Scan Status Ok
Last Scan2026-01-19T01:44:17+00:00
Next Scan 2026-01-26T01:44:17+00:00

Last Scan

Scanned2026-01-19T01:44:17+00:00
URL https://ispaniagid.ru/robots.txt
Domain IPs 104.21.36.188, 172.67.198.145, 2606:4700:3033::6815:24bc, 2606:4700:3037::ac43:c691
Response IP 172.67.198.145
Found Yes
Hash b3be4dc273c45e5c62e5418d9dd586eff0be705911b27ed6410ce079da9706df
SimHash 30dcd2d2f08a

Groups

yandex
googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

rogerbot
exabot
mj12bot
dotbot
gigabot
dataforseobot

Rule Path
Disallow /
Back to top

Warnings

  • `clean-param` is not a known field.
Back to top