di.dk
robots.txt

Robots Exclusion Standard data for di.dk

Resource Scan

Scan Details

Site Domain di.dk
Base Domain di.dk
Scan Status Ok
Last Scan2025-10-21T00:27:17+00:00
Next Scan 2025-11-20T00:27:17+00:00

Last Scan

Scanned2025-10-21T00:27:17+00:00
URL https://di.dk/robots.txt
Redirect https://www.danskindustri.dk/robots.txt
Redirect Domain www.danskindustri.dk
Redirect Base danskindustri.dk
Domain IPs 20.50.64.15, 20.82.233.223
Redirect IPs 104.17.202.6, 104.17.203.6, 2606:4700::6811:ca06, 2606:4700::6811:cb06
Response IP 104.17.202.6
Found Yes
Hash d2a294971fd2ffdfa9b77159785bffdd18e159be104c2d11e719a3e25fe5dbd2
SimHash 791dd455fcb5

Groups

*

Rule Path
Disallow /episerver
Disallow /EPiServer
Disallow /App_Data
Disallow /modules
Disallow /*?SearchQuery
Disallow /*?TopicFilter
Disallow /DownloadDocument
Disallow /soeg/
Disallow /english/soeg/
Disallow /*.pdf$
Disallow /*.docx$
Disallow /*.xlsx$
Disallow /*.pptx$
Disallow /arrangementstilmelding

Other Records

Field Value
sitemap https://www.danskindustri.dk/sitemap.xml