treatwell.co.uk
robots.txt

Robots Exclusion Standard data for treatwell.co.uk

Resource Scan

Scan Details

Site Domain treatwell.co.uk
Base Domain treatwell.co.uk
Scan Status Ok
Last Scan2024-11-05T04:43:53+00:00
Next Scan 2024-11-19T04:43:53+00:00

Last Scan

Scanned2024-11-05T04:43:53+00:00
URL https://treatwell.co.uk/robots.txt
Redirect https://www.treatwell.co.uk/robots.txt
Redirect Domain www.treatwell.co.uk
Redirect Base treatwell.co.uk
Domain IPs 216.137.52.11, 216.137.52.126, 216.137.52.54, 216.137.52.57
Redirect IPs 65.9.112.116, 65.9.112.30, 65.9.112.36, 65.9.112.44
Response IP 3.164.68.116
Found Yes
Hash 42099392f707e4d31e5cb3a59bbe6388f88491947d3a57eb34f22cc0d46c92ca
SimHash ad54eaa2c128

Groups

adsbot-google

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /m/
Disallow /lookbook/
Disallow /lookbook/look/look
Disallow /lookbook/looks/*locations
Disallow /places/treatment-*brand-
Disallow /places/*postal-
Disallow /places/*postal-within-
Disallow /places/*geocode-
Disallow /places/*ext-in-
Disallow /places/*ext-within-
Disallow /places/treatment-*accolade-
Disallow /places/*dynamic
Disallow /places/treatment-*tag-
Disallow /places/treatment-*offer-tag-
Disallow /places/*max-duration-
Disallow /places/*price-
Disallow /places/*sub-locations-
Disallow /places/*buy-as-
Disallow /places/*discount-
Disallow /places/*available-from-
Disallow /places/*available-on-
Disallow /places/*available-to-
Disallow /places/*available-in-
Disallow /places/*available-in-the-next-
Disallow /places/*time-range-
Disallow /places/*sort-
Disallow /places/treatment-*/at-
Disallow /places/for-*-nights/offer-type-local/
Disallow /places/*/for-*-nights/offer-type-local/
Disallow /places/accolade-
Disallow /places/*%2C
Disallow /places/*/day-of-week-
Disallow /places/offer-tag-
Disallow /places/at-*/offer-type-
Disallow /places/brand-*/offer-type-
Disallow /places/*view%3Dmap
Disallow /places/*amenity-
Disallow /secure-checkout
Disallow */partners/feed/
Disallow /checkout
Disallow /availability
Disallow /reschedule-bookings
Disallow *weitere

Other Records

Field Value
sitemap http://www.treatwell.co.uk/site-map-index.xml