upf.edu
robots.txt
Robots Exclusion Standard data for upf.edu
Resource Scan
Scan Details
| Site Domain | upf.edu |
| Base Domain | upf.edu |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-11T05:16:43+00:00 |
| Next Scan | 2025-01-09T05:16:43+00:00 |
Last Successful Scan
| Scanned | 2023-11-23T23:44:50+00:00 |
| URL | https://upf.edu/robots.txt |
| Redirect | https://www.upf.edu/robots.txt |
| Redirect Domain | www.upf.edu |
| Redirect Base | upf.edu |
| Domain IPs | 34.160.111.234 |
| Redirect IPs | 104.18.18.224, 104.18.19.224, 2606:4700::6812:12e0, 2606:4700::6812:13e0 |
| Response IP | 104.18.18.224 |
| Found | Yes |
| Hash | 4f574b33c14b077c4070e3d360e4b59c44713f654487c7edee6d93f014da9332 |
| SimHash | f1123efc8fd0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /intranet |
| Disallow | /loginupf-ext |
| Disallow | /web/guest-old |
| Disallow | */web/guest/* |
| Disallow | */c/portal* |
| Disallow | */web/mercatdelpeix/* |
| Disallow | */web/seu-electronica/* |
| Disallow | */web/ibe/* |
| Disallow | /web/expo-st-jordi |
| Disallow | /web/ddb/* |
| Disallow | /web/cau/* |
| Disallow | /*?p_p_* |
| Disallow | /documents/213063326/ |
| Disallow | /web/neologismedelany |
| Disallow | /web/arsenal |
| Disallow | /web/passaport-upf |
| Disallow | /web/transformacio-digital |
| Disallow | /web/signosfera |
| Disallow | /web/micromegas |
| Disallow | /web/centre-digital-humanities |
| Disallow | /web/mastercomunicacio |
| Disallow | /web/enric-dmz |
| Disallow | /web/gestio-tramits |
| Disallow | /web/universitat/nafsa |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.upf.edu/sitemap.xml |
Comments