Log In Sign Up

pokur.su
robots.txt

Robots Exclusion Standard data for pokur.su

Resource Scan

Scan Details

Site Domain pokur.su
Base Domain pokur.su
Scan Status Ok
Last Scan2024-11-15T13:34:17+00:00
Next Scan 2024-11-22T13:34:17+00:00

Last Scan

Scanned2024-11-15T13:34:17+00:00
URL https://pokur.su/robots.txt
Domain IPs 104.21.12.193, 172.67.132.96, 2606:4700:3030::6815:cc1, 2606:4700:3030::ac43:8460
Response IP 172.67.132.96
Found Yes
Hash 73e6ac70c3edfb05ac0930732c4d5017db8ca357b39f1d1d252712485a98e3ac
SimHash d21ed8e0ee11

Groups

*
yandex

Rule Path
Disallow /search/
Disallow /system/

yandex
ahrefsbot
amazonbot
semrushbot
dataforseobot
dotbot
barkrowler
petalbot
serendeputybot
mj12bot
netestate
blexbot
seopultcontentanalyzer
ccbot
megaindex
megaindexbot
serpstatbot
zoominfobot
linkfluence
netcraftsurveyagent
geedobot
gptbot
awariorssbot
awariosmartbot
grapeshot

Rule Path
Disallow /
Back to top

Warnings

  • `clean-param` is not a known field.
Back to top