themodernproper.com
robots.txt

Robots Exclusion Standard data for themodernproper.com

Resource Scan

Scan Details

Site Domain themodernproper.com
Base Domain themodernproper.com
Scan Status Ok
Last Scan2025-08-17T11:06:47+00:00
Next Scan 2025-08-24T11:06:47+00:00

Last Scan

Scanned2025-08-17T11:06:47+00:00
URL https://themodernproper.com/robots.txt
Domain IPs 104.26.10.216, 104.26.11.216, 172.67.75.207, 2606:4700:20::681a:ad8, 2606:4700:20::681a:bd8, 2606:4700:20::ac43:4bcf
Response IP 104.26.10.216
Found Yes
Hash 4fa291200f264c689cb92c8e1b09e0e9a3f9413f06a7e3c7b41cb0cd40439f64
SimHash 6378195637b2

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://themodernproper.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://themodernproper.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/