udg.es
robots.txt
Robots Exclusion Standard data for udg.es
Resource Scan
Scan Details
| Site Domain | udg.es |
| Base Domain | udg.es |
| Scan Status | Ok |
| Last Scan | 2025-06-09T04:34:37+00:00 |
| Next Scan | 2025-07-09T04:34:37+00:00 |
Last Scan
| Scanned | 2025-06-09T04:34:37+00:00 |
| URL | https://udg.es/robots.txt |
| Redirect | https://www.udg.edu/ca/robots.txt |
| Redirect Domain | www.udg.edu |
| Redirect Base | udg.edu |
| Domain IPs | 84.88.131.9 |
| Redirect IPs | 84.88.131.14 |
| Response IP | 84.88.131.14 |
| Found | Yes |
| Hash | 2cb85a8fecf3a7b0143b926d93ba54953e965987b0e7767cd53d4db1d72b82eb |
| SimHash | 99b91153c5c6 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /*/ctl/ | Googlebot permits * |
| Disallow | /admin/ | - |
| Disallow | /App_Browsers/ | - |
| Disallow | /App_Code/ | - |
| Disallow | /App_Data/ | - |
| Disallow | /App_GlobalResources/ | - |
| Disallow | /bin/ | - |
| Disallow | /Components/ | - |
| Disallow | /Config/ | - |
| Disallow | /contest/ | - |
| Disallow | /controls/ | - |
| Disallow | /Documentation/ | - |
| Disallow | /HttpModules/ | - |
| Disallow | /Install/ | - |
| Disallow | /Providers/ | - |
| Disallow | /Activity-Feed/userId/ | Do not index user profiles |
| Disallow | /Portals/_default/ | - |
| Disallow | /dnn-api/ | - |
| Disallow | /Resources/ContentRotator/ | - |
| Disallow | /Resources/ControlPanel/ | - |
| Disallow | /Resources/Dashboard/ | - |
| Disallow | /Resources/FeedBrowser/ | - |
| Disallow | /Resources/OpenForceAd/ | - |
| Disallow | /Resources/SkinWidgets/ | - |
| Disallow | /Resources/TabStrip/ | - |
| Disallow | /Resources/Widgets/ | - |
| Disallow | /Activity-Feed/userId/ | Do not index user profiles |
| Disallow | /*?returnurl= | - |
| Disallow | /activity-feed/ | - |
| Disallow | /*postid | - |
| Disallow | /community?utm_term* | - |
| Disallow | /community?utm_source* | - |
| Disallow | /DesktopModules/LinkExchange/* | - |
| Disallow | /wiki/Page/DotNetNuke-Cookie-usage | - |
| Disallow | /users/* | - |
| Disallow | /docs/* | - |
| Disallow | *BannerId%3D** | - |
| Disallow | *VendorId%3D* | - |
| Disallow | *PortalId%3D* | - |
| Disallow | *bit.ly%3D* | - |
| Disallow | *aspxerrorpath%3D* | - |
| Disallow | *cx%3D* | - |
| Disallow | *fileticket%3D* | - |
| Disallow | *tabid%3D* | - |
| Disallow | *forumid%3D* | - |
| Disallow | *mid%3D* | - |
| Disallow | *groupId%3D* | - |
| Disallow | *GroupID%3D* | - |
| Disallow | *helpversion%3D* | - |
| Disallow | *link%3D* | - |
| Disallow | *name%3D* | - |
| Disallow | *page%3D* | - |
| Disallow | *path%3D* | - |
| Disallow | *project%3D* | - |
| Disallow | *scope%3D* | - |
| Disallow | *skinningcontest%3D* | - |
| Disallow | *TabID%3D* | - |
| Disallow | *ModuleID%3D* | - |
| Disallow | *AuthorID%3D* | - |
| Disallow | *tag%3D* | - |
| Disallow | *tags%3D* | - |
| Disallow | *td%3D* | - |
| Disallow | *time%3D* | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Comments