spravkin.org
robots.txt

Robots Exclusion Standard data for spravkin.org

Resource Scan

Scan Details

Site Domain spravkin.org
Base Domain spravkin.org
Scan Status Ok
Last Scan2024-10-05T04:45:01+00:00
Next Scan 2024-10-12T04:45:01+00:00

Last Scan

Scanned2024-10-05T04:45:01+00:00
URL https://spravkin.org/robots.txt
Domain IPs 104.21.36.209, 172.67.199.154, 2606:4700:3033::6815:24d1, 2606:4700:3035::ac43:c79a
Response IP 104.21.36.209
Found Yes
Hash 980aa5925ff746aa13a35a5078b8b02f1021622f53f8129c5c3324f9ae05007b
SimHash 9edf5ce0fe91

Groups

*
yandex

Rule Path
Disallow /search/
Disallow /system/

yandex
semrushbot
dataforseobot
dotbot
barkrowler
petalbot
serendeputybot
mj12bot
netestate
blexbot
seopultcontentanalyzer
ccbot
megaindex
megaindexbot
serpstatbot
zoominfobot
linkfluence
netcraftsurveyagent
geedobot

Rule Path
Disallow /

Warnings

  • `clean-param` is not a known field.