treatwell.nl
robots.txt

Robots Exclusion Standard data for treatwell.nl

Resource Scan

Scan Details

Site Domain treatwell.nl
Base Domain treatwell.nl
Scan Status Ok
Last Scan2024-09-23T02:35:15+00:00
Next Scan 2024-10-07T02:35:15+00:00

Last Scan

Scanned2024-09-23T02:35:15+00:00
URL https://treatwell.nl/robots.txt
Redirect https://www.treatwell.nl/robots.txt
Redirect Domain www.treatwell.nl
Redirect Base treatwell.nl
Domain IPs 216.137.52.11, 216.137.52.126, 216.137.52.54, 216.137.52.57
Redirect IPs 216.137.52.11, 216.137.52.126, 216.137.52.54, 216.137.52.57
Response IP 65.9.112.30
Found Yes
Hash a539be667df0231e2c996330fcf79befc44f9cc8ea5198c98533155dbf75c2e1
SimHash af583c13f201

Groups

adsbot-google

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /m/
Disallow /lookbook/
Disallow /lookbook/look/look
Disallow /lookbook/looks/*locations
Disallow /salons/behandeling-*brand-
Disallow /salons/*postcode-
Disallow /salons/*postcode-in-
Disallow /salons/*geocode-
Disallow /salons/*ext-in-
Disallow /salons/*ext-binnen-
Disallow /salons/behandeling-*award-
Disallow /salons/*dynamisch
Disallow /salons/behandeling-*tag-
Disallow /salons/behandeling-*aanbod-tag-
Disallow /salons/*tijdsduur-max-
Disallow /salons/*prijs-
Disallow /salons/*sub-locaties-
Disallow /salons/*kopen-als-
Disallow /salons/*korting-
Disallow /salons/*beschikbaar-vanaf-
Disallow /salons/*beschikbaar-op-
Disallow /salons/*beschikbaar-tot-
Disallow /salons/*beschikbaar-binnen-
Disallow /salons/*beschikbaar-de-volgende-
Disallow /salons/*tijdsbestek-
Disallow /salons/*sorteren-
Disallow /salons/behandeling-*/bij-
Disallow /salons/voor-*-nachten/aanbod-type-lokaal/
Disallow /salons/*/voor-*-nachten/aanbod-type-lokaal/
Disallow /salons/award-
Disallow /salons/*%2C
Disallow /salons/*/dag-van-de-week-
Disallow /salons/aanbod-tag-
Disallow /salons/bij-*/aanbod-type-
Disallow /salons/brand-*/aanbod-type-
Disallow /salons/*view%3Dmap
Disallow /salons/*voorziening-
Disallow /secure-checkout
Disallow */partners/feed/
Disallow /checkout
Disallow /availability
Disallow /reschedule-bookings
Disallow /en/places/treatment-*brand-
Disallow /en/places/*postal-
Disallow /en/places/*postal-within-
Disallow /en/places/*geocode-
Disallow /en/places/*ext-in-
Disallow /en/places/*ext-within-
Disallow /en/places/treatment-*accolade-
Disallow /en/places/*dynamic
Disallow /en/places/treatment-*tag-
Disallow /en/places/treatment-*offer-tag-
Disallow /en/places/*max-duration-
Disallow /en/places/*price-
Disallow /en/places/*sub-locations-
Disallow /en/places/*buy-as-
Disallow /en/places/*discount-
Disallow /en/places/*available-from-
Disallow /en/places/*available-on-
Disallow /en/places/*available-to-
Disallow /en/places/*available-in-
Disallow /en/places/*available-in-the-next-
Disallow /en/places/*time-range-
Disallow /en/places/*sort-
Disallow /en/places/treatment-*/at-
Disallow /en/places/for-*-nights/offer-type-local/
Disallow /en/places/*/for-*-nights/offer-type-local/
Disallow /en/places/accolade-
Disallow /en/places/*%2C
Disallow /en/places/*/day-of-week-
Disallow /en/places/offer-tag-
Disallow /en/places/at-*/offer-type-
Disallow /en/places/brand-*/offer-type-
Disallow /en/places/*view%3Dmap
Disallow /en/places/*amenity-
Disallow /en/secure-checkout
Disallow */partners/feed/
Disallow /en/checkout
Disallow /en/availability
Disallow /en/reschedule-bookings
Disallow *weitere

Other Records

Field Value
sitemap http://www.treatwell.nl/site-map-index.xml