villanova.edu
robots.txt
Robots Exclusion Standard data for villanova.edu
Resource Scan
Scan Details
| Site Domain | villanova.edu |
| Base Domain | villanova.edu |
| Scan Status | Ok |
| Last Scan | 2024-11-13T15:56:43+00:00 |
| Next Scan | 2024-11-27T15:56:43+00:00 |
Last Scan
| Scanned | 2024-11-13T15:56:43+00:00 |
| URL | https://villanova.edu/robots.txt |
| Redirect | http://www.villanova.edu/robots.txt |
| Redirect Domain | www.villanova.edu |
| Redirect Base | villanova.edu |
| Domain IPs | 153.104.7.164 |
| Redirect IPs | 34.192.188.38, 44.210.212.108 |
| Response IP | 34.192.188.38 |
| Found | Yes |
| Hash | 5b896810463d5663d93cdbf10c3184cc8d92dd1de86424120d80e555eb94bec8 |
| SimHash | ad50c4227123 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /*?cid* |
| Disallow | /*%26cid* |
| Disallow | /*?ncid* |
| Disallow | /*%26ncid* |
| Disallow | /*?link* |
| Disallow | /*%26link* |
| Disallow | /*?lx* |
| Disallow | /*%26lx* |
| Disallow | /*?jso* |
| Disallow | /*%26jso* |
| Disallow | /*?page* |
| Disallow | /*%26page* |
| Disallow | /*?search* |
| Disallow | /*%26search* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www1.villanova.edu/sitemap.xml |
Comments