hdsp.co
robots.txt
Robots Exclusion Standard data for hdsp.co
Resource Scan
Scan Details
Site Domain | hdsp.co |
Base Domain | hdsp.co |
Scan Status | Ok |
Last Scan | 2024-10-21T21:30:17+00:00 |
Next Scan | 2024-11-04T21:30:17+00:00 |
Last Scan
Scanned | 2024-10-21T21:30:17+00:00 |
URL | https://hdsp.co/robots.txt |
Redirect | https://www.headspace.com/robots.txt |
Redirect Domain | www.headspace.com |
Redirect Base | headspace.com |
Domain IPs | 3.165.102.115, 3.165.102.5, 3.165.102.81, 3.165.102.83 |
Redirect IPs | 13.33.88.106, 13.33.88.121, 13.33.88.58, 13.33.88.92 |
Response IP | 13.33.88.58 |
Found | Yes |
Hash | 8c19d4be3af5748e1b58aef33e3b9ca50f951fe5544c21d6bb53ccbc746c1d55 |
SimHash | 880989119cd3 |
Groups
*
Rule | Path |
---|---|
Disallow | /login |
Disallow | /modal/* |
Disallow | /my/* |
Disallow | /auth/ |
Disallow | /missing-email/ |
Disallow | /logout/ |
Disallow | /register |
Disallow | /debug/ |
Disallow | /currency/* |
Disallow | /c/* |
Disallow | /forum/* |
Disallow | /administrator* |
Disallow | /blog/author/matt-rowland-hill |
Disallow | /campaign/* |
Disallow | /verify-email/* |
Disallow | /sharing-is-caring/* |
Disallow | /subscription/* |
Disallow | /_partial/header |
Disallow | /oops |
Disallow | /verify-email/* |
Disallow | /buy/checkout/* |
Disallow | /de/ |
Disallow | /fr/ |
Disallow | /es/ |
Disallow | /pt/ |
Disallow | /invite/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.headspace.com/sitemap.xml |