wm.edu
robots.txt
Robots Exclusion Standard data for wm.edu
Resource Scan
Scan Details
| Site Domain | wm.edu |
| Base Domain | wm.edu |
| Scan Status | Ok |
| Last Scan | 2024-05-05T23:47:11+00:00 |
| Next Scan | 2024-05-19T23:47:11+00:00 |
Last Scan
| Scanned | 2024-05-05T23:47:11+00:00 |
| URL | https://wm.edu/robots.txt |
| Redirect | https://www.wm.edu/robots.txt |
| Redirect Domain | www.wm.edu |
| Redirect Base | wm.edu |
| Domain IPs | 128.239.29.10 |
| Redirect IPs | 2600:9000:24ec:1000:a:719c:280:93a1, 2600:9000:24ec:1600:a:719c:280:93a1, 2600:9000:24ec:5200:a:719c:280:93a1, 2600:9000:24ec:9800:a:719c:280:93a1, 2600:9000:24ec:a00:a:719c:280:93a1, 2600:9000:24ec:c200:a:719c:280:93a1, 2600:9000:24ec:ca00:a:719c:280:93a1, 2600:9000:24ec:e600:a:719c:280:93a1, 65.9.112.123, 65.9.112.125, 65.9.112.2, 65.9.112.6 |
| Response IP | 18.165.171.123 |
| Found | Yes |
| Hash | 2ce1dc34287d0f5240da2ca8650efa42732b5c6fed21adc4334c272d627e0afb |
| SimHash | cc61677c1a80 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_auto/ |
| Disallow | /_carf/ |
| Disallow | /_external/ |
| Disallow | /_hidden/ |
| Disallow | /_infofor/_images/ |
| Disallow | /_internal/ |
| Disallow | /_php/ |
| Disallow | /_temp/ |
| Disallow | /_test/ |
| Disallow | /_tmp/ |
| Disallow | /_tst/ |
| Disallow | /cgi-bin/ |
| Disallow | /scripts/ |
| Disallow | /swf/ |
| Disallow | /temp/ |
| Disallow | /test/ |
| Disallow | /tmp/ |
| Disallow | /tools/ |
| Disallow | /training/ |
| Disallow | /tst/ |
| Disallow | */_hidden |
| Disallow | */_temp |
| Disallow | */_test |
| Disallow | */_tmp |
| Disallow | */_tst |
| Disallow | */hidden/ |
| Disallow | */temp/ |
| Disallow | */test/ |
| Disallow | */tmp/ |
| Disallow | */tst/ |
| Disallow | /a-z/ |
| Disallow | /a-0/ |
| Disallow | /admission/new-undergraduateadmission/ |
| Disallow | /admission/undergraduateadmission/welcome/visit/sneak-peek/ |
| Disallow | /admission/undergraduateadmission/welcome/visit/monroeweekend/ |
| Disallow | /as/training/ |
| Disallow | /news/video/video-popup-pages/ |
| Disallow | /offices/dccenter/plan-events/areahotels/club-quarters/ |
| Disallow | /sites/cerc/ |
| Disallow | /social.php |
| Disallow | /wewillupdatethispageasinformationbecomesavailable.php |
| Disallow | */wewillupdatethispageasinformationbecomesavailable.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.wm.edu/sitemap.xml |