Log In Sign Up

it.purdue.edu
robots.txt

Robots Exclusion Standard data for it.purdue.edu

Resource Scan

Scan Details

Site Domain it.purdue.edu
Base Domain purdue.edu
Scan Status Ok
Last Scan2025-06-19T07:05:26+00:00
Next Scan 2025-07-19T07:05:26+00:00

Last Scan

Scanned2025-06-19T07:05:26+00:00
URL https://it.purdue.edu/robots.txt
Domain IPs 128.210.7.200
Response IP 128.210.7.200
Found Yes
Hash 2fd6e2f953ac7afecf3088265ef0a73a47be55645391ce96efee00a1f7726ec7
SimHash 6029604d6297

Groups

*

Rule Path
Disallow /~
Disallow /pmm-templates/
Disallow /discoverypark/bdmce/events/
Disallow /discoverypark/bdmce/news/
Disallow /discoverypark/bioscience/events/
Disallow /discoverypark/bioscience/news/
Disallow /discoverypark/birck/events/
Disallow /discoverypark/birck/news/
Disallow /discoverypark/c3bio/events/
Disallow /discoverypark/c3bio/news/
Disallow /discoverypark/caid/events/
Disallow /discoverypark/caid/news/
Disallow /discoverypark/climate/events/
Disallow /discoverypark/climate/news/
Disallow /discoverypark/drug-discovery/events/
Disallow /discoverypark/drug-discovery/news/
Disallow /discoverypark/energy/events/
Disallow /discoverypark/energy/news/
Disallow /discoverypark/environment/events/
Disallow /discoverypark/environment/news/
Disallow /discoverypark/food/events/
Disallow /discoverypark/food/news/
Disallow /discoverypark/igsdi/events/
Disallow /discoverypark/igsdi/news/
Disallow /discoverypark/nextrans/events/
Disallow /discoverypark/nextrans/news/
Disallow /discoverypark/pillars/integrative-neuroscience-center/events/
Disallow /discoverypark/pillars/integrative-neuroscience-center/news/
Disallow /discoverypark/pillars/pi4d/events/
Disallow /discoverypark/pillars/pi4d/news/
Disallow /discoverypark/ppri/events/
Disallow /discoverypark/ppri/news/
Disallow /discoverypark/rche/events/
Disallow /discoverypark/rche/news/
Disallow /discoverypark/vaccine/events/
Disallow /discoverypark/vaccine/news/
Disallow /discoverypark/wghi/events/
Disallow /discoverypark/wghi/news/
Disallow /gradschool/gsdb/
Disallow /hhs/hdfs/r28j51xz/
Disallow /vet/application
Disallow /vet/badges
Disallow /vet/blocks
Disallow /vet/building-directory
Disallow /vet/campaign-emails
Disallow /vet/courses
Disallow /vet/ctr/files/documents/CTR-Research-Information.pdf
Disallow /vet/ctr/files/documents/CTR-Translational-Research.pdf
Disallow /vet/dvmconnect
Disallow /vet/epubs
Disallow /vet/files/includes
Disallow /vet/fileshare
Disallow /vet/intranet
Disallow /vet/pcop/videos
Disallow /vet/scheduler
Disallow /vet/secure
Disallow /vet/sharepoint
Disallow /vet/supportpvm
Disallow /vet/sureshmittal
Disallow /vet/test
Disallow /vet/vtconnect
Disallow /vet/vth/files/documents/181108-rDVM-Fall-Mailing.pdf
Disallow /vet/addl/covid19partners/

Other Records

Field Value
crawl-delay 3
Back to top

Other Records

Field Value
sitemap https://www.purdue.edu/sitemap.xml
sitemap https://www.purdue.edu/science/sitemap.xml
Back to top

Comments

  • Discovery Park
  • Updated by Jakob Knigga (jknigga) 9/21/2017
  • Gradschool
  • HHS
  • Updated by Lisa Stein 1/27/2017 - FP 764035
  • Vet
  • Updated by Osmar Lopez 5/29/2019 - FP 1114881
  • Updated by Wright Frazier 4/8/2020 - FP 1289068
  • Site Map
  • Added College of Science sitemap.xml file per Nina Haghighi - FP 1719630
Back to top

Warnings

  • 1 invalid line.
Back to top