bditdata.xyz
robots.txt

Robots Exclusion Standard data for bditdata.xyz

Resource Scan

Scan Details

Site Domain bditdata.xyz
Base Domain bditdata.xyz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2025-11-11T00:24:14+00:00
Next Scan 2025-11-25T00:24:14+00:00

Last Successful Scan

Scanned2025-10-01T11:42:00+00:00
URL https://bditdata.xyz/robots.txt
Redirect https://www.bditdata.xyz/robots.txt
Redirect Domain www.bditdata.xyz
Redirect Base bditdata.xyz
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 142.251.10.121, 2404:6800:4003:c1a::79
Response IP 172.217.194.121
Found Yes
Hash 70268a1b79fff4b745a58e7b3c4a50c59d37df5326a91d816d7548acfc3161a8
SimHash 49149050c753

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Disallow /share-widget
Allow /

Other Records

Field Value
sitemap https://www.bditdata.xyz/sitemap.xml