mckinsey.com
robots.txt

Robots Exclusion Standard data for mckinsey.com

Resource Scan

Scan Details

Site Domain mckinsey.com
Base Domain mckinsey.com
Scan Status Ok
Last Scan2024-06-18T00:10:48+00:00
Next Scan 2024-07-02T00:10:48+00:00

Last Scan

Scanned2024-06-18T00:10:48+00:00
URL https://mckinsey.com/robots.txt
Redirect https://www.mckinsey.com/robots.txt
Redirect Domain www.mckinsey.com
Redirect Base mckinsey.com
Domain IPs 157.191.4.253
Redirect IPs 23.39.5.97
Response IP 184.28.52.55
Found Yes
Hash dc6b48d1f5ac38b0c5ea7ca165d11f680546b4bdcc86808d8394033bac45c8de
SimHash e3472dbe6233

Groups

*

Rule Path
Disallow /*.axd
Disallow /modules/
Disallow /sitecore/
Disallow /layouts/
Disallow /Sublayouts/
Disallow /sitecore_files/
Disallow /upload/
Disallow /NotFound.aspx
Disallow /InternalError.html
Disallow /*undefined$
Disallow /services/forms/formapi.asmx/jsdebug
Disallow /services/forms/formapi.asmx/js
Disallow /error
Disallow /ClientLink/
Disallow /clientlink/
Disallow /AppData
Disallow /McKinsey/
Disallow /content/
Disallow /tools/Wrappers
Disallow /user_registration/
Disallow /user-registration
Disallow /search
Disallow /RSS/
Disallow /insights/rss.aspx
Disallow /nocookie
Disallow /noaccess
Disallow /html/
Disallow /assets/dotcom/staging/
Disallow /gsa/
Disallow /practice-clients/
Disallow /Practice-Clients/
Disallow /alumniappload/
Disallow /AlumniAppLoad/
Disallow /alumniappload
Disallow /AlumniAppLoad

gsa-crawler

Rule Path
Allow /clientlink/
Allow /gsa/
Allow /practice-clients/

amazon-kendra

Product Comment
amazon-kendra Amazon Kendra Web Crawler
Rule Path Comment
Disallow / disallow access to any pages

Other Records

Field Value
sitemap https://www.mckinsey.com/sitemap.xml

Comments

  • undefined
  • jsdebug
  • Miscellaneous exclusions

Warnings

  • 1 invalid line.