gdzrobot.com.ua
robots.txt

Robots Exclusion Standard data for gdzrobot.com.ua

Resource Scan

Scan Details

Site Domain gdzrobot.com.ua
Base Domain gdzrobot.com.ua
Scan Status Ok
Last Scan2025-10-08T20:42:07+00:00
Next Scan 2025-10-15T20:42:07+00:00

Last Scan

Scanned2025-10-08T20:42:07+00:00
URL https://gdzrobot.com.ua/robots.txt
Domain IPs 193.42.111.183
Response IP 193.42.111.183
Found Yes
Hash f8fd5406a237ba870aac5c3209eb590e576b95971105b58890833aef83784e70
SimHash 50144660eab3

Groups

*

Rule Path
Allow /

dotbot

Rule Path
Disallow /

clark-crawler2/nutch-1.19-snapshot

Rule Path
Disallow /

ahrefsbot/7.0

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot/7~bl

Rule Path
Disallow /

mj12bot/v1.4.8

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dataforseobot/1.0

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

rogerbot/1.2

Rule Path
Disallow /

yeti

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://gdzrobot.com.ua/sitemap.xml