dalefarm.com
robots.txt

Robots Exclusion Standard data for dalefarm.com

Resource Scan

Scan Details

Site Domain dalefarm.com
Base Domain dalefarm.com
Scan Status Ok
Last Scan2026-03-01T06:54:42+00:00
Next Scan 2026-03-08T06:54:42+00:00

Last Scan

Scanned2026-03-01T06:54:42+00:00
URL https://dalefarm.com/robots.txt
Domain IPs 51.38.93.55
Response IP 51.38.93.55
Found Yes
Hash 3ac554bb455dd852393b782fcc29b799b583a2122c7cbd0bd8dd4faa19e4b0b6
SimHash c3581d727793

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://dalefarm.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://dalefarm.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/