gites.com
robots.txt

Robots Exclusion Standard data for gites.com

Resource Scan

Scan Details

Site Domain gites.com
Base Domain gites.com
Scan Status Ok
Last Scan2025-09-23T23:44:24+00:00
Next Scan 2025-10-23T23:44:24+00:00

Last Scan

Scanned2025-09-23T23:44:24+00:00
URL https://gites.com/robots.txt
Redirect https://www.gites.com/robots.txt
Redirect Domain www.gites.com
Redirect Base gites.com
Domain IPs 104.18.12.46, 104.18.13.46, 2606:4700::6812:c2e, 2606:4700::6812:d2e
Redirect IPs 104.18.12.46, 104.18.13.46, 2606:4700::6812:c2e, 2606:4700::6812:d2e
Response IP 104.18.12.46
Found Yes
Hash 05c4855a80845842df0e58a48471e6ff0c3d4924dcc30d1400c3e1b2f3b34d90
SimHash cffc89588d53

Groups

*

Rule Path
Disallow /nl/aanbieder/*
Disallow /en/provider/*
Disallow /fr/fournisseur/*
Disallow /de/anbieter/*
Disallow */auth/verification
Disallow /gebruiker
Disallow /nl/gebruiker
Disallow /user
Disallow /en/user
Disallow /fournisseur
Disallow /fr/fournisseur
Disallow /anbieter
Disallow /de/anbieter
Disallow /superadmin
Disallow /admin
Disallow /nl/superadmin
Disallow /nl/admin
Disallow /en/superadmin
Disallow /en/admin
Disallow /fr/superadmin
Disallow /fr/admin
Disallow /de/superadmin
Disallow /de/admin
Disallow /superadmin/*
Disallow /admin/*
Disallow /nl/superadmin/*
Disallow /nl/admin/*
Disallow /en/superadmin/*
Disallow /en/admin/*
Disallow /fr/superadmin/*
Disallow /fr/admin/*
Disallow /de/superadmin/*
Disallow /de/admin/*
Disallow /include_availability/*
Disallow /availability/*
Disallow /rentals/*/embed
Disallow /de/ferienwohnungen/*/embed
Disallow /en/holiday-homes/*/embed
Disallow /nl/vakantiehuizen/*/embed
Disallow /fr/gites/*/embed
Disallow /nl/rentals/*/embed
Disallow /nl/tehuur/*/embed
Disallow /en/for-rent/*/embed
Disallow /fr/a-louer/*/embed
Disallow /de/zu-mieten/*/embed
Disallow */mail_friends/*
Disallow /favorite/*
Disallow /unfavorite/*
Disallow /guestbook_entries/*
Disallow /*/embed

Other Records

Field Value
sitemap https://www.gites.com/sitemap.xml

Comments

  • Provider pages don't offer valuable information
  • Verification page
  • User pages
  • Admin pages
  • Availability pages only for embedding
  • Send to a friend links
  • AJAX calls
  • We don't need to index guestbook entries
  • Don't index embedded calendars either