customd.com
robots.txt

Robots Exclusion Standard data for customd.com

Resource Scan

Scan Details

Site Domain customd.com
Base Domain customd.com
Scan Status Ok
Last Scan2024-09-11T11:15:38+00:00
Next Scan 2024-10-11T11:15:38+00:00

Last Scan

Scanned2024-09-11T11:15:38+00:00
URL https://customd.com/robots.txt
Domain IPs 13.33.88.127, 13.33.88.13, 13.33.88.31, 13.33.88.77, 2600:9000:223b:2000:0:7ab2:ad40:93a1, 2600:9000:223b:2600:0:7ab2:ad40:93a1, 2600:9000:223b:9000:0:7ab2:ad40:93a1, 2600:9000:223b:a800:0:7ab2:ad40:93a1, 2600:9000:223b:aa00:0:7ab2:ad40:93a1, 2600:9000:223b:be00:0:7ab2:ad40:93a1, 2600:9000:223b:da00:0:7ab2:ad40:93a1, 2600:9000:223b:dc00:0:7ab2:ad40:93a1
Response IP 13.33.88.127
Found Yes
Hash 7f102484161a07043427b15fd5135cea5dd3c1cd9823eb53ad4f0b00cce71642
SimHash 61681d562f92

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.customd.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.customd.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/