html5doctor.com
robots.txt

Robots Exclusion Standard data for html5doctor.com

Resource Scan

Scan Details

Site Domain html5doctor.com
Base Domain html5doctor.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-23T01:20:28+00:00
Next Scan 2025-10-07T01:20:28+00:00

Last Successful Scan

Scanned2025-08-15T22:16:41+00:00
URL https://html5doctor.com/robots.txt
Domain IPs 77.72.1.44
Response IP 77.72.1.44
Found Yes
Hash 92ac5f391a693563033b0fe6ac9ae17cc1d2e149a8c794961f9ee5be733cc0d7
SimHash 6b114cc08b93

Groups

*

Rule Path
Disallow /mail.html5doctor.com/
Disallow /html5doctor.com/search/

Other Records

Field Value
sitemap http://html5doctor.com/sitemap.xml.gz