dobob.org
robots.txt

Robots Exclusion Standard data for dobob.org

Resource Scan

Scan Details

Site Domain dobob.org
Base Domain dobob.org
Scan Status Ok
Last Scan2025-10-11T20:14:18+00:00
Next Scan 2025-10-18T20:14:18+00:00

Last Scan

Scanned2025-10-11T20:14:18+00:00
URL https://dobob.org/robots.txt
Domain IPs 104.21.11.182, 172.67.166.238, 2606:4700:3035::6815:bb6, 2606:4700:3035::ac43:a6ee
Response IP 104.21.11.182
Found Yes
Hash 483990422052ff8cc949e7b26a71c4ac092359202b594ee6e60c78b8c3db748f
SimHash 184c9340f920

Groups

googlebot

Rule Path
Disallow /oc-external/
Disallow /oc-admin/
Disallow /innova-my-favorite-items/
Disallow /wishlist_list
Disallow /oc-content/plugins/printpdf*

mediapartners-google

Rule Path
Allow /

*

Rule Path
Disallow /oc-external/
Disallow /oc-admin/
Disallow /innova-my-favorite-items/
Disallow /wishlist_list
Disallow /oc-content/plugins/printpdf*

yandex

Rule Path
Disallow /oc-external/
Disallow /oc-admin/
Disallow /innova-my-favorite-items/
Disallow /wishlist_list
Disallow /oc-content/plugins/printpdf*

baiduspider

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /