chefswarehouse.com
robots.txt

Robots Exclusion Standard data for chefswarehouse.com

Resource Scan

Scan Details

Site Domain chefswarehouse.com
Base Domain chefswarehouse.com
Scan Status Ok
Last Scan2024-09-21T04:38:56+00:00
Next Scan 2024-10-21T04:38:56+00:00

Last Scan

Scanned2024-09-21T04:38:56+00:00
URL https://chefswarehouse.com/robots.txt
Redirect https://www.chefswarehouse.com/robots.txt
Redirect Domain www.chefswarehouse.com
Redirect Base chefswarehouse.com
Domain IPs 217.114.94.2
Redirect IPs 104.18.37.231, 172.64.150.25, 2606:4700:4400::6812:25e7, 2606:4700:4400::ac40:9619
Response IP 104.18.37.231
Found Yes
Hash 882210840cae94a261f71f72027b5cd76c4d8512b07286a0b008ee20b02cef46
SimHash 2154204fc4b4

Groups

*

Rule Path
Disallow /EPiServer/CMS/
Disallow /Util/

Other Records

Field Value
sitemap https://www.chefswarehouse.com/sitemap.xml
sitemap https://www.chefswarehouse.com/commerce-dairy-sitemap.xml
sitemap https://www.chefswarehouse.com/commerce-pantry-sitemap.xml
sitemap https://www.chefswarehouse.com/commerce-cheese-sitemap.xml
sitemap https://www.chefswarehouse.com/commerce-beverages-sitemap.xml
sitemap https://www.chefswarehouse.com/commerce-baking-sitemap.xml
sitemap https://www.chefswarehouse.com/commerce-meat-sitemap.xml
sitemap https://www.chefswarehouse.com/commerce-supplies-sitemap.xml
sitemap https://www.chefswarehouse.com/commerce-seafood-sitemap.xml
sitemap https://www.chefswarehouse.com/commerce-fresh-sitemap.xml
sitemap https://www.chefswarehouse.com/products-1-sitemap.xml
sitemap https://www.chefswarehouse.com/products-2-sitemap.xml