mccormick.com
robots.txt

Robots Exclusion Standard data for mccormick.com

Resource Scan

Scan Details

Site Domain mccormick.com
Base Domain mccormick.com
Scan Status Ok
Last Scan2024-11-14T08:27:56+00:00
Next Scan 2024-11-21T08:27:56+00:00

Last Scan

Scanned2024-11-14T08:27:56+00:00
URL https://mccormick.com/robots.txt
Redirect https://www.mccormick.com/robots.txt
Redirect Domain www.mccormick.com
Redirect Base mccormick.com
Domain IPs 108.157.254.122, 108.157.254.19, 108.157.254.21, 108.157.254.28
Redirect IPs 108.157.254.122, 108.157.254.19, 108.157.254.21, 108.157.254.28
Response IP 108.157.254.21
Found Yes
Hash 0881028021923428cbe2a77500f4f35f7899045398ad4257fc802542621a3e3c
SimHash c86d3234cf85

Groups

*

Rule Path
Allow /*?$
Disallow /*?
Disallow /bin
Disallow /xsl
Disallow /temp
Disallow /Areas
Disallow /Tests
Disallow /Views
Allow /lyticsbot
Allow /-/media/*
Disallow /Models
Disallow /OLDBAY
Disallow /upload
Disallow /*?item
Disallow /layouts
Disallow /itecore
Disallow /*search
Disallow /App_Data
Disallow /sitecore
Disallow /sitemaps
Disallow /App_Config
Disallow /Properties
Disallow /TEMPFOLDER
Disallow /default.js
Disallow /Web.config
Allow /*/bundles/*.js
Disallow /Controllers
Disallow /default.css
Disallow /Global.asax
Disallow /webedit.css
Allow /*/bundles/*.css
Disallow /App_Browsers
Disallow /Dictionaries
Disallow /Default.aspx
Disallow /aspnet_client
Disallow /sitecore_files
Disallow /Summertime-Treats
Disallow /Spring_Into_Baking
Disallow /flavor-maker-discounts
Disallow /sitemaps/mkc-sitemap-en.xml
Disallow /flavor-forecast-subscription

Other Records

Field Value
sitemap https://www.mccormick.com/sitemap.xml
sitemap https://www.mccormick.com/sitemap-video.xml

Warnings

  • 3 invalid lines.