kth.se
robots.txt

Robots Exclusion Standard data for kth.se

Resource Scan

Scan Details

Site Domain kth.se
Base Domain kth.se
Scan Status Ok
Last Scan2026-01-21T01:42:44+00:00
Next Scan 2026-02-04T01:42:44+00:00

Last Scan

Scanned2026-01-21T01:42:44+00:00
URL https://kth.se/robots.txt
Redirect https://www.kth.se/robots.txt
Redirect Domain www.kth.se
Redirect Base kth.se
Domain IPs 130.237.28.40, 2001:6b0:1:11c2::82ed:1c28
Redirect IPs 130.237.28.40, 2001:6b0:1:11c2::82ed:1c28
Response IP 130.237.28.40
Found Yes
Hash b9a54f8cd049e1daed9fc9957f90b5c70d6b82c3f530ebe72f14e9a4be741577
SimHash 2d4ffd89ff52

Groups

*

Rule Path
Disallow /lediga-jobb/language_redirect/
Disallow /lediga-jobb/interna/
Disallow /form/
Disallow /public/
Disallow /cm/
Disallow /info/
Disallow /work/
Disallow /xyz/
Disallow /xyz
Disallow /en/xyz/
Disallow /en/xyz
Disallow /2.994/
Disallow /2.9631/
Disallow /2.1019/
Disallow /2.1166/
Disallow /2.1218/
Disallow /2.1219/
Disallow /2.36446/
Disallow /2.14566/
Disallow /2.28744/
Disallow /2.98714/
Disallow /en/2.28744/
Disallow /2.9631/
Disallow /en/2.9631/
Disallow /search
Disallow /social/user/_report_/abuse/
Disallow /gemensamt/kategorier-1.31190
Disallow /en/gemensamt/kategorier-1.31190
Disallow /social/api/profile/1.1/
Disallow /test/
Disallow /blogs/tags
Disallow /es/
Disallow /*?rss=*
Disallow /*?iCal=*
Disallow /api/icalendar/
Disallow /start/
Disallow /intranat
Disallow /sci/2.840

Other Records

Field Value
sitemap https://www.kth.se/sitemap.xml

Comments

  • well-known resource robots.txt from 17.392