pokur.su
robots.txt

Robots Exclusion Standard data for pokur.su

Resource Scan

Scan Details

Site Domain pokur.su
Base Domain pokur.su
Scan Status Ok
Last Scan2024-06-13T20:42:21+00:00
Next Scan 2024-06-20T20:42:21+00:00

Last Scan

Scanned2024-06-13T20:42:21+00:00
URL https://pokur.su/robots.txt
Domain IPs 104.21.12.193, 172.67.132.96, 2606:4700:3030::6815:cc1, 2606:4700:3030::ac43:8460
Response IP 104.21.12.193
Found Yes
Hash 42593e43eee46c9292026296dcec09eb6b0f8d4b13ba12ffd7af35e0a8c1d4da
SimHash 561ed8e0fa91

Groups

*
yandex

Rule Path
Disallow /search/
Disallow /system/

yandex
ahrefsbot
amazonbot
semrushbot
dataforseobot
dotbot
barkrowler
petalbot
serendeputybot
mj12bot
netestate
blexbot
seopultcontentanalyzer
ccbot
megaindex
megaindexbot
serpstatbot
zoominfobot
linkfluence
netcraftsurveyagent
geedobot
gptbot
awariorssbot
awariosmartbot
grapeshot

Rule Path
Disallow /

Warnings

  • `clean-param` is not a known field.