probanki.org
robots.txt

Robots Exclusion Standard data for probanki.org

Resource Scan

Scan Details

Site Domain probanki.org
Base Domain probanki.org
Scan Status Ok
Last Scan2024-10-05T03:25:54+00:00
Next Scan 2024-10-12T03:25:54+00:00

Last Scan

Scanned2024-10-05T03:25:54+00:00
URL https://probanki.org/robots.txt
Domain IPs 45.67.58.213
Response IP 45.67.58.213
Found Yes
Hash 2d158070fbe2ffe908a1a3904bace889572adeed07ffcc275eedac01834d273b
SimHash 5ede54c0fe91

Groups

*
yandex

Rule Path
Disallow /search/
Disallow /system/
Disallow /promo/

yandex
semrushbot
dataforseobot
dotbot
barkrowler
petalbot
serendeputybot
mj12bot
netestate
blexbot
seopultcontentanalyzer
ccbot
megaindex
megaindexbot
serpstatbot
zoominfobot
linkfluence
netcraftsurveyagent
geedobot

Rule Path
Disallow /

Warnings

  • `clean-param` is not a known field.