datadot.biz
robots.txt

Robots Exclusion Standard data for datadot.biz

Resource Scan

Scan Details

Site Domain datadot.biz
Base Domain datadot.biz
Scan Status Ok
Last Scan2025-11-23T08:03:12+00:00
Next Scan 2025-12-23T08:03:12+00:00

Last Scan

Scanned2025-11-23T08:03:12+00:00
URL https://datadot.biz/robots.txt
Domain IPs 104.21.10.21, 172.67.162.33, 2606:4700:3030::ac43:a221, 2606:4700:3033::6815:a15
Response IP 172.67.162.33
Found Yes
Hash f746e6bb107cdcef4d19a5903b1491098eedfcedd21f68bcdbc12311206c8195
SimHash 28187013c193

Groups

*

Rule Path
Disallow /fcmedianet.js
Disallow /__media__/js/templates.js
Disallow /cmedianet
Disallow /cmdynet
Disallow /mediamainlog.php

googlebot

Rule Path
Disallow

slurp

Rule Path
Disallow

msnbot

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

*

Rule Path
Disallow /