davidharsent.com
robots.txt

Robots Exclusion Standard data for davidharsent.com

Resource Scan

Scan Details

Site Domain davidharsent.com
Base Domain davidharsent.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan4/16/2025, 12:19:00 AM
Next Scan 7/15/2025, 12:19:00 AM

Last Successful Scan

Scanned8/26/2024, 11:31:02 PM
URL https://davidharsent.com/robots.txt
Redirect https://sdhajar.com/robots.txt
Redirect Domain sdhajar.com
Redirect Base sdhajar.com
Domain IPs 104.21.37.94, 172.67.206.218, 2606:4700:3032::ac43:ceda, 2606:4700:3035::6815:255e
Redirect IPs 104.21.91.66, 172.67.211.87, 2606:4700:3033::ac43:d357, 2606:4700:3037::6815:5b42
Response IP 172.67.211.87
Found Yes
Hash 8a6e41dbe7fda1c76812740ce51a39cb4eb38cc024a605e05a37b1b00b9e5fdc
SimHash 4905dc504f13

Groups

*

Rule Path
Allow /
Disallow /search

Other Records

Field Value
sitemap https://sdcahaya.com/sitemap.xml