www.kellogg.northwestern.edu
robots.txt

Robots Exclusion Standard data for www.kellogg.northwestern.edu

Resource Scan

Scan Details

Site Domain www.kellogg.northwestern.edu
Base Domain northwestern.edu
Scan Status Ok
Last Scan2024-06-26T17:09:45+00:00
Next Scan 2024-07-26T17:09:45+00:00

Last Scan

Scanned2024-06-26T17:09:45+00:00
URL https://www.kellogg.northwestern.edu/robots.txt
Domain IPs 165.124.147.150
Response IP 165.124.147.150
Found Yes
Hash bb2e8295d677e3780fc76938b021b4c2cdc6c67a4967e48dcb023e29743434f1
SimHash 5574bd75cd14

Groups

*

Rule Path
Allow /emp/intranet/schedules/emba_icals
Disallow /welcome
Disallow /kis/software
Disallow /stu_aff/rooms
Disallow /emp/intranet
Disallow /faculty/honack/htm
Disallow /faculty/honack/ftp
Disallow /faculty/bio
Disallow /invest/
Disallow /academic/tmp
Disallow /student/sp-event/vcic
Disallow /student/ksa/serial/free-busy-instructions.doc
Disallow /weboverhaul
Disallow /kis/emp
Disallow /gfx
Disallow /student/club/demo
Disallow /student/gim
Disallow /career_student/documents/
Disallow /Programs/PTMBA-Welcome.aspx
Disallow /student/club/
Disallow /layouts/vcard.aspx?id=seb327
Disallow /faculty/matsa/exec
Disallow /parttime/intranetfiles
Disallow /~/media/Files/CMC/SecureRepository-Auth
Disallow /~/media/Files/CMC/SecureRepository
Disallow /~/media/Files/alumni/private
Disallow /docs/secure
Disallow /*deprecated
Disallow /email
Disallow /klg-uat
Disallow /__Deprecated
Disallow /mbawelcome
Disallow /kellogg-welcome
Disallow /emba-intranet
Disallow /faculty-old

ia_archiver

Rule Path
Disallow /faculty/weber
Disallow /news_articles/media%20hits

rogerbot

Rule Path
Disallow /*.htm$
Disallow /*.html$

Other Records

Field Value
sitemap https://www.kellogg.northwestern.edu/docs/xml/sitemap.xml
sitemap https://www.kellogg.northwestern.edu/docs/xml/FacultySitemap.xml
sitemap https://www.kellogg.northwestern.edu/docs/xml/WebsiteSitemap.xml
sitemap https://www.kellogg.northwestern.edu/docs/xml/CaseStudySitemap.xml