webster.ch
robots.txt
Robots Exclusion Standard data for webster.ch
Resource Scan
Scan Details
Site Domain | webster.ch |
Base Domain | webster.ch |
Scan Status | Ok |
Last Scan | 2025-09-07T08:05:43+00:00 |
Next Scan | 2025-10-07T08:05:43+00:00 |
Last Scan
Scanned | 2025-09-07T08:05:43+00:00 |
URL | http://webster.ch/robots.txt |
Redirect | https://geneva.webster.edu/robots.txt |
Redirect Domain | geneva.webster.edu |
Redirect Base | webster.edu |
Domain IPs | 3.209.26.193, 34.236.193.193, 52.73.2.219 |
Redirect IPs | 3.209.26.193, 34.236.193.193, 52.73.2.219 |
Response IP | 3.209.26.193 |
Found | Yes |
Hash | 6967d64127f84c4d3d78688de9845cb40ed9efcd24cedb092162f1a30d563aa5 |
SimHash | 0b21f65eed02 |
Groups
*
Rule | Path |
---|---|
Disallow | /404.php |
Disallow | /_resources/ |
Disallow | /academics/faculty/profiles/index.php |
Disallow | /academics/undergraduate/programs/ |
Disallow | /academics/undergraduate/programs.php |
Disallow | /admissions/apply.php |
Disallow | /blog/images/ |
Disallow | /bookstore/ |
Disallow | /campusmap/ |
Disallow | /commencement/ |
Disallow | /currentstudents/learningcenter.php |
Disallow | /currentstudents/careerservices/ |
Disallow | /currentstudents/residentiallife/resources/ |
Disallow | /cyber/ |
Disallow | /documents/ |
Disallow | /events/index.php |
Disallow | /faculty/ |
Disallow | /gdpr/ |
Disallow | /globalgovernance/ |
Disallow | /ihsc/ |
Disallow | /images/ |
Disallow | /index-225138.php |
Disallow | /it/ |
Disallow | /live/ |
Disallow | /mamce/ |
Disallow | /mba/ |
Disallow | /mce/ |
Disallow | /media/ |
Disallow | /orientation/ |
Disallow | /sante/ |
Disallow | /sga/ |
Disallow | /studyabroad/ |
Disallow | /success/redirect.php |
Disallow | /summeracademy/ |
Disallow | /webster-geneva-spotlight/images/ |
Disallow | /webster-geneva-spotlight/testing.php |
Disallow | /wha/ |
Other Records
Field | Value |
---|---|
sitemap | https://geneva.webster.edu/sitemap.xml |