studium.uu.se
robots.txt
Robots Exclusion Standard data for studium.uu.se
Resource Scan
Scan Details
| Site Domain | studium.uu.se |
| Base Domain | uu.se |
| Scan Status | Ok |
| Last Scan | 2024-05-30T05:20:53+00:00 |
| Next Scan | 2024-06-29T05:20:53+00:00 |
Last Scan
| Scanned | 2024-05-30T05:20:53+00:00 |
| URL | https://studium.uu.se/robots.txt |
| Domain IPs | 130.238.7.133, 130.238.7.134, 130.238.7.135, 2001:6b0:b:242:130:238:7:133, 2001:6b0:b:242:130:238:7:134, 2001:6b0:b:242:130:238:7:135 |
| Response IP | 130.238.7.133 |
| Found | Yes |
| Hash | e32dd8061fade958792bee727b8f1e51f7469f979b1b3deeb38d0abaf273068d |
| SimHash | eb3cfcb84e92 |
Groups
ahrefsbot
bygglobot
bytespider
claudebot
comodospider
discobot
docomo
dotbot
exabot
ezooms
findlinks
garlikcrawler
hapax newscrawler
huaweisymantecspider
megaindex.ru
mj12bot
mlbot
nerdbynature.bot
nigma.ru
petalbot
pflab
piplbot
psbot
purebot
rankurbot
scoutjet
seekport crawler
seekportbot
semrushbot
semrushbot-sa
sistrix crawler
sitebot
speedy spider
testnutch
trends crawler
unchaos real time trends bot
web.idrc.ca/challenge
webvac
| Rule | Path |
|---|---|
| Disallow | / |
*
bingbot
| Rule | Path |
|---|---|
| Disallow | /*facet_link%3D1* |
| Disallow | /*catAttribute |
| Disallow | /*catattribute |
| Disallow | /*categoryAttribute |
| Disallow | /*categoryattribute |
| Disallow | /*calendarMonth |
| Disallow | /*calendarmonth |
| Disallow | /*startDateTime |
| Disallow | /*startdatetime |
| Disallow | /*endDateTime |
| Disallow | /*enddatetime |
| Disallow | /*freeText |
| Disallow | /*freetext |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.studium.uu.se/sitemap |
Warnings
- 1 invalid line.