merlinford.com
robots.txt

Robots Exclusion Standard data for merlinford.com

Resource Scan

Scan Details

Site Domain merlinford.com
Base Domain merlinford.com
Scan Status Ok
Last Scan2025-08-02T12:02:15+00:00
Next Scan 2025-09-01T12:02:15+00:00

Last Scan

Scanned2025-08-02T12:02:15+00:00
URL https://merlinford.com/robots.txt
Redirect https://www.merlinford.com/robots.txt
Redirect Domain www.merlinford.com
Redirect Base merlinford.com
Domain IPs 3.167.69.112, 3.167.69.119, 3.167.69.82, 3.167.69.84
Redirect IPs 108.157.254.109, 108.157.254.114, 108.157.254.36, 108.157.254.75, 2600:9000:2014:1e00:1b:ac0a:e400:93a1, 2600:9000:2014:3800:1b:ac0a:e400:93a1, 2600:9000:2014:5200:1b:ac0a:e400:93a1, 2600:9000:2014:5800:1b:ac0a:e400:93a1, 2600:9000:2014:8600:1b:ac0a:e400:93a1, 2600:9000:2014:a00:1b:ac0a:e400:93a1, 2600:9000:2014:ac00:1b:ac0a:e400:93a1, 2600:9000:2014:c600:1b:ac0a:e400:93a1
Response IP 108.157.254.109
Found Yes
Hash 6cfe8465ea150ce3197044d38914bc88c7b833cd63ac534082a8bade29d1ed44
SimHash c1301d563792

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.merlinford.com/sitemaps-60-sitemap.xml

Comments

  • robots.txt for https://www.merlinford.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/