di.se
robots.txt

Robots Exclusion Standard data for di.se

Resource Scan

Scan Details

Site Domain di.se
Base Domain di.se
Scan Status Ok
Last Scan2024-04-27T00:45:31+00:00
Next Scan 2024-05-04T00:45:31+00:00

Last Scan

Scanned2024-04-27T00:45:31+00:00
URL https://di.se/robots.txt
Redirect https://www.di.se/robots.txt
Redirect Domain www.di.se
Redirect Base di.se
Domain IPs 34.117.105.189
Redirect IPs 23.52.113.111, 2600:1413:b000:380::31b3, 2600:1413:b000:397::31b3
Response IP 23.54.57.172
Found Yes
Hash b8446bb80a26e65b157570de74692b5158b25047729ee1ab7bec10efeca943c2
SimHash 3a2d5850ad77

Groups

*

Rule Path
Disallow /_alive/
Disallow /_alive
Disallow /login*
Disallow /search*
Disallow /bors/search*
Disallow /*?tab=
Disallow /*?page=
Disallow /konto/*
Disallow /insider-bolag/
Disallow /finansiell-information/pressreleaser-per-foretag/
Disallow /finansiell-information/pressreleaser/?page=
Disallow /insider-person/
Disallow /Comments/WebServices/
Disallow /*?fhtab=
Disallow /*%26fhtab%3D
Disallow /*?allakommentarer=
Disallow /*%26allakommentarer%3D
Disallow /*?timestamp=
Disallow /*%26timestamp%3D
Disallow /*?t=
Disallow /*%26t%3D
Disallow /*?flik=
Disallow /*%26flik%3D
Disallow /*?qr=
Disallow /*%26qr%3D
Disallow /*?screenwidth
Disallow /*%26screenwidth
Disallow /*?screenheight
Disallow /*%26screenheight
Disallow /*?ctl
Disallow /*%26ctl
Disallow /*?currentIndex=
Disallow /*?ns_
Disallow /*%26ns_
Disallow /bip/
Disallow /bip-callback*
Disallow /register*
Disallow /part*
Disallow /akademi/anmalan/*
Disallow /akademi/info-utbildningar/
Disallow /34405621/bn/*
Disallow /di-fonder/*
Disallow /_humlan/
Disallow /_humlan

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Disallow /walls/freemium/*
Disallow /walls/premium/*

Other Records

Field Value
sitemap https://www.di.se/sitemap.xml
sitemap https://www.di.se/sitemap-news.xml