rug.nl
robots.txt
Robots Exclusion Standard data for rug.nl
Resource Scan
Scan Details
| Site Domain | rug.nl |
| Base Domain | rug.nl |
| Scan Status | Ok |
| Last Scan | 2025-04-11T16:48:55+00:00 |
| Next Scan | 2025-04-25T16:48:55+00:00 |
Last Scan
| Scanned | 2025-04-11T16:48:55+00:00 |
| URL | https://rug.nl/robots.txt |
| Redirect | https://www.rug.nl/robots.txt |
| Redirect Domain | www.rug.nl |
| Redirect Base | rug.nl |
| Domain IPs | 129.125.2.51, 2001:610:1a08:292:129:125:2:51 |
| Redirect IPs | 129.125.2.51, 2001:610:1a08:292:129:125:2:51 |
| Response IP | 129.125.2.51 |
| Found | Yes |
| Hash | 7c6c8f2c143dfd47ea9270ebbd835da7d44da8ace0dac62f3ca4b7b63c044863 |
| SimHash | c2087900c1ca |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /sciencelinx/blackholegame/index.html/robots.txt |
| Disallow | /_shared/ |
| Disallow | /webvernieuwing/ |
| Disallow | /forms/ |
| Disallow | /*browseandselect |
| Disallow | /*browseAndSelect |
| Disallow | /*%21find |
| Disallow | /*%21mailTo |
| Disallow | /*%21languagepreference |
| Disallow | /*%21content |
| Disallow | /*%21getAnalytics |
| Disallow | /*%21rss |
| Disallow | /*%21sso |
| Disallow | /*/old-research |
| Disallow | /society-business/centre-for-information-technology/organisation/pictogram/archief/ |
| Disallow | /*?*pageSize= |
| Disallow | /*?*ordering= |
| Disallow | /*?*nofollow=true |
| Disallow | /*/concepts/ |
| Disallow | /*.rss |
| Disallow | /*.xps |
| Disallow | /*hfid%3D |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.rug.nl/sitemaps/publicSitemapIndex.xml |