damianclark.com
robots.txt

Robots Exclusion Standard data for damianclark.com

Resource Scan

Scan Details

Site Domain damianclark.com
Base Domain damianclark.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-03-03T00:01:04+00:00
Next Scan 2025-06-01T00:01:04+00:00

Last Successful Scan

Scanned2024-04-14T22:33:44+00:00
URL https://damianclark.com/robots.txt
Redirect https://www.austinartistsproject.org/robots.txt
Redirect Domain www.austinartistsproject.org
Redirect Base austinartistsproject.org
Domain IPs 104.21.29.158, 172.67.149.112, 2606:4700:3036::ac43:9570, 2606:4700:3037::6815:1d9e
Redirect IPs 104.21.51.177, 172.67.183.56, 2606:4700:3032::6815:33b1, 2606:4700:3035::ac43:b738
Response IP 104.21.51.177
Found Yes
Hash 2ddf60b5d28bbb52d5d029251d6f157410a3ef1089860855b69c943acaa7ecad
SimHash 6354dc524611

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.austinartistsproject.org/sitemap.xml