chicagobooth.edu
robots.txt

Robots Exclusion Standard data for chicagobooth.edu

Resource Scan

Scan Details

Site Domain chicagobooth.edu
Base Domain chicagobooth.edu
Scan Status Ok
Last Scan2024-10-23T13:33:35+00:00
Next Scan 2024-11-22T13:33:35+00:00

Last Scan

Scanned2024-10-23T13:33:35+00:00
URL https://chicagobooth.edu/robots.txt
Redirect https://www.chicagobooth.edu/robots.txt
Redirect Domain www.chicagobooth.edu
Redirect Base chicagobooth.edu
Domain IPs 128.135.211.104
Redirect IPs 128.135.211.104
Response IP 128.135.211.104
Found Yes
Hash f85d33fb311ae9908c1738f061a4f08a234137f8f62427abbf4c1f7ad2faeb67
SimHash f92205164b9d

Groups

booth-crawler

Rule Path
Disallow

twitterbot

Rule Path
Disallow

powermapper

Rule Path
Allow /

*

Rule Path
Disallow /?source=
Disallow /?utm_source=
Disallow /gleacher/
Disallow /cgi-bin/
Disallow /includes/
Disallow /widgets/
Disallow /css/
Disallow /admin/
Disallow /searchgoogle/
Disallow /sawtooth/
Disallow /secure/
Disallow /email/
Disallow /toolkit/
Disallow /landing/
Disallow /smlanding/
Disallow /*.pdf
Disallow /computingservices/private/
Disallow /exitpoll/
Disallow /usmpf/
Disallow /fulltime/admits/
Disallow /parttime/admits/
Disallow /execmba/admits/
Disallow /gab/
Disallow /fulltime/engage/includes/
Disallow /execmba/engage/includes/
Disallow /execmba/includes/
Disallow /parttime/includes/
Disallow /summerscholars/includes/
Disallow /shapetheclass/
Disallow /profiles/text/
Disallow /dpdf/
Disallow /rd/
Disallow /media/85CC0787D27E40C585AA6246CB2E4C56.pdf
Disallow /informationtechnology/
Disallow /facultypages/
Disallow /assests/
Disallow /alumni/summit/
Disallow /employmentreport/docs/
Disallow /topic/
Disallow /?sc_lang=en
Disallow /en/
Disallow /programs/ewadmit
Disallow /programs/ftadmit
Disallow /programs/execmbaadmit
Disallow /home/
Disallow /test/
Disallow /executiveeducation/back-to-booth
Disallow /training/
Disallow /sitecore/content/
Disallow /facultyold/
Disallow /pre-production/
Disallow /sites/
Disallow /booth-survey.html
Disallow /executiveeducation/programs/leadership/organizational-resilience
Disallow /boothtemplates/
Disallow /boothwebkit/
Disallow /distinguishedfellows/
Disallow /distinguished-fellows/
Disallow /GenerateXML.aspx
Disallow /FTMBAStories.xml
Disallow /WhyBoothStories.xml
Disallow /ALUMStories.xml
Disallow /RUSStories.xml
Disallow /MAGStories.xml
Disallow /CBRStories.xml
Disallow /XPMBAStories.xml
Disallow /PTMBAStories.xml
Disallow /CAAIStories.xml
Disallow /ROMANStories.xml
Disallow /HealthStories.xml
Disallow /blank.xml
Disallow /secure/analytics/
Disallow /booth-error.html

Other Records

Field Value
sitemap http://www.chicagobooth.edu/sitemap.xml