hdsp.co
robots.txt

Robots Exclusion Standard data for hdsp.co

Resource Scan

Scan Details

Site Domain hdsp.co
Base Domain hdsp.co
Scan Status Ok
Last Scan2024-10-21T21:30:17+00:00
Next Scan 2024-11-04T21:30:17+00:00

Last Scan

Scanned2024-10-21T21:30:17+00:00
URL https://hdsp.co/robots.txt
Redirect https://www.headspace.com/robots.txt
Redirect Domain www.headspace.com
Redirect Base headspace.com
Domain IPs 3.165.102.115, 3.165.102.5, 3.165.102.81, 3.165.102.83
Redirect IPs 13.33.88.106, 13.33.88.121, 13.33.88.58, 13.33.88.92
Response IP 13.33.88.58
Found Yes
Hash 8c19d4be3af5748e1b58aef33e3b9ca50f951fe5544c21d6bb53ccbc746c1d55
SimHash 880989119cd3

Groups

twitterbot

Rule Path
Allow /invite/*

*

Rule Path
Disallow /login
Disallow /modal/*
Disallow /my/*
Disallow /auth/
Disallow /missing-email/
Disallow /logout/
Disallow /register
Disallow /debug/
Disallow /currency/*
Disallow /c/*
Disallow /forum/*
Disallow /administrator*
Disallow /blog/author/matt-rowland-hill
Disallow /campaign/*
Disallow /verify-email/*
Disallow /sharing-is-caring/*
Disallow /subscription/*
Disallow /_partial/header
Disallow /oops
Disallow /verify-email/*
Disallow /buy/checkout/*
Disallow /de/
Disallow /fr/
Disallow /es/
Disallow /pt/
Disallow /invite/*

Other Records

Field Value
sitemap https://www.headspace.com/sitemap.xml