webster.ch
robots.txt

Robots Exclusion Standard data for webster.ch

Resource Scan

Scan Details

Site Domain webster.ch
Base Domain webster.ch
Scan Status Ok
Last Scan2025-09-07T08:05:43+00:00
Next Scan 2025-10-07T08:05:43+00:00

Last Scan

Scanned2025-09-07T08:05:43+00:00
URL http://webster.ch/robots.txt
Redirect https://geneva.webster.edu/robots.txt
Redirect Domain geneva.webster.edu
Redirect Base webster.edu
Domain IPs 3.209.26.193, 34.236.193.193, 52.73.2.219
Redirect IPs 3.209.26.193, 34.236.193.193, 52.73.2.219
Response IP 3.209.26.193
Found Yes
Hash 6967d64127f84c4d3d78688de9845cb40ed9efcd24cedb092162f1a30d563aa5
SimHash 0b21f65eed02

Groups

*

Rule Path
Disallow /404.php
Disallow /_resources/
Disallow /academics/faculty/profiles/index.php
Disallow /academics/undergraduate/programs/
Disallow /academics/undergraduate/programs.php
Disallow /admissions/apply.php
Disallow /blog/images/
Disallow /bookstore/
Disallow /campusmap/
Disallow /commencement/
Disallow /currentstudents/learningcenter.php
Disallow /currentstudents/careerservices/
Disallow /currentstudents/residentiallife/resources/
Disallow /cyber/
Disallow /documents/
Disallow /events/index.php
Disallow /faculty/
Disallow /gdpr/
Disallow /globalgovernance/
Disallow /ihsc/
Disallow /images/
Disallow /index-225138.php
Disallow /it/
Disallow /live/
Disallow /mamce/
Disallow /mba/
Disallow /mce/
Disallow /media/
Disallow /orientation/
Disallow /sante/
Disallow /sga/
Disallow /studyabroad/
Disallow /success/redirect.php
Disallow /summeracademy/
Disallow /webster-geneva-spotlight/images/
Disallow /webster-geneva-spotlight/testing.php
Disallow /wha/

Other Records

Field Value
sitemap https://geneva.webster.edu/sitemap.xml