wahanda.com
robots.txt

Robots Exclusion Standard data for wahanda.com

Resource Scan

Scan Details

Site Domain wahanda.com
Base Domain wahanda.com
Scan Status Ok
Last Scan2024-04-28T02:22:27+00:00
Next Scan 2024-05-28T02:22:27+00:00

Last Scan

Scanned2024-04-28T02:22:27+00:00
URL https://wahanda.com/robots.txt
Redirect https://www.treatwell.co.uk/robots.txt
Redirect Domain www.treatwell.co.uk
Redirect Base treatwell.co.uk
Domain IPs 204.246.191.14, 204.246.191.27, 204.246.191.37, 204.246.191.8
Redirect IPs 108.157.188.106, 108.157.188.26, 108.157.188.45, 108.157.188.78
Response IP 3.160.246.113
Found Yes
Hash 0339a663277b9b11c9541cb1c8f3440bca98697ee3f4c18be05d3a151e895f9a
SimHash ed55eaa1c360

Groups

adsbot-google

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /m/
Disallow /lookbook/
Disallow /lookbook/look/look
Disallow /lookbook/looks/*locations
Disallow /places/treatment-*brand-
Disallow /places/*postal-
Disallow /places/*postal-within-
Disallow /places/*geocode-
Disallow /places/*ext-in-
Disallow /places/*ext-within-
Disallow /places/treatment-*accolade-
Disallow /places/*dynamic
Disallow /places/treatment-*tag-
Disallow /places/treatment-*offer-tag-
Disallow /places/*max-duration-
Disallow /places/*price-
Disallow /places/*sub-locations-
Disallow /places/*buy-as-
Disallow /places/*discount-
Disallow /places/*available-from-
Disallow /places/*available-on-
Disallow /places/*available-to-
Disallow /places/*available-in-
Disallow /places/*available-in-the-next-
Disallow /places/*time-range-
Disallow /places/*sort-
Disallow /places/treatment-*/at-
Disallow /places/for-*-nights/offer-type-local/
Disallow /places/*/for-*-nights/offer-type-local/
Disallow /places/accolade-
Disallow /places/*%2C
Disallow /places/*/day-of-week-
Disallow /places/offer-tag-
Disallow /places/at-*/offer-type-
Disallow /places/brand-*/offer-type-
Disallow /places/*view%3Dmap
Disallow /places/*amenity-
Disallow /secure-checkout
Disallow */partners/feed/
Disallow *weitere

Other Records

Field Value
sitemap http://www.treatwell.co.uk/site-map-index.xml