treatwell.fr
robots.txt

Robots Exclusion Standard data for treatwell.fr

Resource Scan

Scan Details

Site Domain treatwell.fr
Base Domain treatwell.fr
Scan Status Ok
Last Scan2024-05-20T00:07:09+00:00
Next Scan 2024-06-03T00:07:09+00:00

Last Scan

Scanned2024-05-20T00:07:09+00:00
URL https://treatwell.fr/robots.txt
Redirect https://www.treatwell.fr/robots.txt
Redirect Domain www.treatwell.fr
Redirect Base treatwell.fr
Domain IPs 143.204.29.18, 143.204.29.66, 143.204.29.9, 143.204.29.96
Redirect IPs 18.161.6.14, 18.161.6.43, 18.161.6.66, 18.161.6.68
Response IP 108.157.52.122
Found Yes
Hash df94a748e3248979ade9ed264ed49b340baa0dafe2a6748194428889ee178fbb
SimHash 2d8008ea8b81

Groups

adsbot-google

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /m/
Disallow /lookbook/
Disallow /lookbook/look/look
Disallow /lookbook/looks/*locations
Disallow /salons/soin-*marque-
Disallow /salons/*code-postal-
Disallow /salons/*code-postal-dans-
Disallow /salons/*geocode-
Disallow /salons/*ext-a-
Disallow /salons/*ext-dans-
Disallow /salons/soin-*recompense-
Disallow /salons/*automatique
Disallow /salons/soin-*etiquette-
Disallow /salons/soin-*offre-etiquette-
Disallow /salons/*duree-max-
Disallow /salons/*prix-
Disallow /salons/*sous-emplacement-
Disallow /salons/*acheter-en-tant-que-
Disallow /salons/*reduction-
Disallow /salons/*disponible-du-
Disallow /salons/*disponible-le-
Disallow /salons/*disponible-jusquau-
Disallow /salons/*disponible-dans-
Disallow /salons/*disponible-dans-les-prochains-
Disallow /salons/*duree-
Disallow /salons/*tri-
Disallow /salons/soin-*/chez-
Disallow /salons/pour-*-nuits/offre-type-local/
Disallow /salons/*/pour-*-nuits/offre-type-local/
Disallow /salons/recompense-
Disallow /salons/*%2C
Disallow /salons/*/jour-de-la-semaine-
Disallow /salons/offre-etiquette-
Disallow /salons/chez-*/offre-type-
Disallow /salons/marque-*/offre-type-
Disallow /salons/*view%3Dmap
Disallow /salons/*equipement-
Disallow /secure-checkout
Disallow */partenaires/feed/
Disallow /checkout
Disallow /availability
Disallow /reschedule-bookings
Disallow *weitere

Other Records

Field Value
sitemap http://www.treatwell.fr/site-map-index.xml