Log In Sign Up

exceptionalvillas.com
robots.txt

Robots Exclusion Standard data for exceptionalvillas.com

Resource Scan

Scan Details

Site Domain exceptionalvillas.com
Base Domain exceptionalvillas.com
Scan Status Ok
Last Scan2026-02-17T15:59:08+00:00
Next Scan 2026-03-19T15:59:08+00:00

Last Scan

Scanned2026-02-17T15:59:08+00:00
URL https://exceptionalvillas.com/robots.txt
Redirect https://www.exceptionalvillas.com/robots.txt
Redirect Domain www.exceptionalvillas.com
Redirect Base exceptionalvillas.com
Domain IPs 172.66.40.219, 172.66.43.37, 2606:4700:3108::ac42:28db, 2606:4700:3108::ac42:2b25
Redirect IPs 172.66.40.219, 172.66.43.37, 2606:4700:3108::ac42:28db, 2606:4700:3108::ac42:2b25
Response IP 172.66.40.219
Found Yes
Hash b4b9ba2f53cc73004448195d6321971b81a955ea1bf319ffd5bddcbf9885c90f
SimHash 6e0c5053c890

Groups

*

Rule Path
Disallow /cdn-cgi/l/email-protection
Disallow /logs/
Disallow /utmp/
Disallow /admin/
Disallow /owner/
Disallow /private/
Disallow /public/custom_scripts/
Disallow /house/*
Disallow /apartment/*
Disallow /villa/*
Disallow /beach-front/*
Disallow /penthouse/*
Disallow /country-house/*
Disallow /condo/*
Disallow /villa-suite/*
Disallow /over-water-villa/*

oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot

Rule Path
Allow /

gptbot
ccbot
google-extended

Rule Path
Disallow /

googlebot
bingbot

Rule Path
Allow /
Disallow /beach-property*
Disallow /fr/*
Disallow /de/*
Disallow */cgi-bin/
Disallow */wp-admin/
Disallow */wp-includes/
Disallow */wp-content/cache/
Disallow */trackback/
Disallow */comments/
Disallow */wp-login.php
Disallow */wp-signup.php
Back to top

Other Records

Field Value
sitemap https://www.exceptionalvillas.com/cache_sitemaps/sitemap.xml
Back to top

Comments

  • Allow AI search and agent use
  • Disallow AI training data collection
  • Allow traditional search indexing
  • Disallow: /listing/*
  • blog disallows
  • Disallow: */wp-content/plugins/
  • Disallow: */wp-content/themes/
Back to top

Warnings

  • `noindex` is not a known field.
Back to top