ub.edu
robots.txt
Robots Exclusion Standard data for ub.edu
Resource Scan
Scan Details
| Site Domain | ub.edu |
| Base Domain | ub.edu |
| Scan Status | Ok |
| Last Scan | 2024-09-09T22:22:03+00:00 |
| Next Scan | 2024-10-09T22:22:03+00:00 |
Last Scan
| Scanned | 2024-09-09T22:22:03+00:00 |
| URL | https://ub.edu/robots.txt |
| Redirect | https://www.ub.edu/robots.txt |
| Redirect Domain | www.ub.edu |
| Redirect Base | ub.edu |
| Domain IPs | 161.116.109.141 |
| Redirect IPs | 161.116.110.164 |
| Response IP | 161.116.110.164 |
| Found | Yes |
| Hash | 13152a4f139a030e98ec1bc7367a843de8b717335fed460b9c0e6b6dbfdec4d1 |
| SimHash | 896248a0c091 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /dyn/cms/pdf/ |
| Disallow | /dyn/cms/system/ |
| Disallow | /dyn/cms/continguts_ca/menu_eines/web_multimedia/ |
| Disallow | /dyn/cms/continguts_es/menu_eines/web_multimedia/ |
| Disallow | /dyn/cms/continguts_en/menu_eines/web_multimedia/ |
| Disallow | /dyn/cms/continguts_ca/altres/muno/ |
| Disallow | /dyn/cms/continguts_es/altres/muno/ |
| Disallow | /dyn/cms/continguts_en/altres/muno/ |
| Disallow | /web/ub/ca/nodisponible.html |
| Disallow | /portal/documents/1051544/*?version= |
| Disallow | /seu-electoral/ |
| Disallow | /ods/ |
Comments