dt-pro.site
robots.txt

Robots Exclusion Standard data for dt-pro.site

Resource Scan

Scan Details

Site Domain dt-pro.site
Base Domain dt-pro.site
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan3/27/2025, 2:57:30 AM
Next Scan 5/26/2025, 2:57:30 AM

Last Successful Scan

Scanned1/4/2025, 12:38:22 AM
URL https://dt-pro.site/robots.txt
Redirect https://datatogel-horse.site/robots.txt
Redirect Domain datatogel-horse.site
Redirect Base datatogel-horse.site
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.60.71, 172.67.193.100, 2606:4700:3030::6815:3c47, 2606:4700:3033::ac43:c164
Response IP 104.21.60.71
Found Yes
Hash 6391d84c58f8480a6644f0e477e0eb5ae28922f6126edc32d98f30656ff95966
SimHash 690d4445c7d3

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://datatogel-horse.site/sitemap.xml