balearic-properties.com
robots.txt

Robots Exclusion Standard data for balearic-properties.com

Resource Scan

Scan Details

Site Domain balearic-properties.com
Base Domain balearic-properties.com
Scan Status Ok
Last Scan2025-02-14T20:00:40+00:00
Next Scan 2025-03-16T20:00:40+00:00

Last Scan

Scanned2025-02-14T20:00:40+00:00
URL https://balearic-properties.com/robots.txt
Redirect https://www.balearic-properties.com/robots.txt
Redirect Domain www.balearic-properties.com
Redirect Base balearic-properties.com
Domain IPs 104.21.6.58, 172.67.154.248, 2606:4700:3030::ac43:9af8, 2606:4700:3037::6815:63a
Redirect IPs 104.21.6.58, 172.67.154.248, 2606:4700:3030::ac43:9af8, 2606:4700:3037::6815:63a
Response IP 104.21.6.58
Found Yes
Hash 3718eecb33628fe52b141923fa4e7ffc0fb0826a550517f24cc1f426b05917de
SimHash 7518c9000c8b

Groups

amazonbot

Product Comment
amazonbot Amazon's Alexa user agent
Rule Path
Disallow /

seznambot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

Rule Path
Disallow /assets/cache/
Disallow /assets/docs/
Disallow /assets/export/
Disallow /assets/import/
Disallow /assets/modules/
Disallow /assets/plugins/
Disallow /assets/snippets/
Disallow /de/property*
Disallow /sv/property*
Disallow /ru/*
Disallow /sv/*

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.balearic-properties.com/sitemap.xml

Comments

  • Default modx exclusions