therapyden.com
robots.txt

Robots Exclusion Standard data for therapyden.com

Resource Scan

Scan Details

Site Domain therapyden.com
Base Domain therapyden.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-11T00:33:21+00:00
Next Scan 2026-02-09T00:33:21+00:00

Last Successful Scan

Scanned2023-07-24T22:23:10+00:00
URL https://therapyden.com/robots.txt
Redirect https://www.therapyden.com/robots.txt
Redirect Domain www.therapyden.com
Redirect Base therapyden.com
Domain IPs 104.26.4.181, 104.26.5.181, 172.67.68.43, 2606:4700:20::681a:4b5, 2606:4700:20::681a:5b5, 2606:4700:20::ac43:442b
Redirect IPs 104.26.4.181, 104.26.5.181, 172.67.68.43, 2606:4700:20::681a:4b5, 2606:4700:20::681a:5b5, 2606:4700:20::ac43:442b
Response IP 104.26.4.181
Found Yes
Hash e7ff5b99e1ea151b2a42a38dc37305ffb548678d5ea4ad64a10b767ed1e5ebf4
SimHash 4b500516b792

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /lib/node_modules/
Disallow /.env

Other Records

Field Value
sitemap https://www.therapyden.com/sitemaps-1-sitemap.xml

Comments

  • Don't allow web crawlers to index Craft CMS