middleburgcommunities.com
robots.txt

Robots Exclusion Standard data for middleburgcommunities.com

Resource Scan

Scan Details

Site Domain middleburgcommunities.com
Base Domain middleburgcommunities.com
Scan Status Ok
Last Scan2025-12-15T13:32:02+00:00
Next Scan 2025-12-22T13:32:02+00:00

Last Scan

Scanned2025-12-15T13:32:02+00:00
URL https://middleburgcommunities.com/robots.txt
Redirect https://www.middleburg.com/robots.txt
Redirect Domain www.middleburg.com
Redirect Base middleburg.com
Domain IPs 104.21.19.213, 172.67.190.56, 2606:4700:3036::ac43:be38, 2606:4700:3037::6815:13d5
Redirect IPs 104.26.4.15, 104.26.5.15, 172.67.75.166, 2606:4700:20::681a:40f, 2606:4700:20::681a:50f, 2606:4700:20::ac43:4ba6
Response IP 172.67.75.166
Found Yes
Hash 1e41fb4497dcbf36c4c24f41c382ff31d5e3b0918c4f0257860178fdd64dd4af
SimHash c1581d567f97

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.middleburg.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.middleburg.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/