rolandfoods.com
robots.txt

Robots Exclusion Standard data for rolandfoods.com

Resource Scan

Scan Details

Site Domain rolandfoods.com
Base Domain rolandfoods.com
Scan Status Ok
Last Scan2024-05-13T07:00:29+00:00
Next Scan 2024-05-20T07:00:29+00:00

Last Scan

Scanned2024-05-13T07:00:29+00:00
URL https://rolandfoods.com/robots.txt
Domain IPs 104.26.12.169, 104.26.13.169, 172.67.74.12, 2606:4700:20::681a:ca9, 2606:4700:20::681a:da9, 2606:4700:20::ac43:4a0c
Response IP 104.26.13.169
Found Yes
Hash c7ca4319e3d3cabb8a14ee4c74c1d739da839ec634863aba1bc0195611dd89d5
SimHash 09081c762792

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://rolandfoods.com/sitemaps-1-sitemap.xml
sitemap https://innovationsummit.rolandfoods.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://rolandfoods.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/