hvidekitler.dk
robots.txt

Robots Exclusion Standard data for hvidekitler.dk

Resource Scan

Scan Details

Site Domain hvidekitler.dk
Base Domain hvidekitler.dk
Scan Status Ok
Last Scan2025-09-09T06:10:50+00:00
Next Scan 2025-10-09T06:10:50+00:00

Last Scan

Scanned2025-09-09T06:10:50+00:00
URL https://hvidekitler.dk/robots.txt
Redirect https://www.hvidekitler.dk/robots.txt
Redirect Domain www.hvidekitler.dk
Redirect Base hvidekitler.dk
Domain IPs 199.34.228.43
Redirect IPs 199.34.228.43
Response IP 199.34.228.43
Found Yes
Hash f1d614a65b12d14e35296afd84e8bf1f1056d3ab78f669760d93ce5552b5cb7e
SimHash 204dd8646e93

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /materialer.html
Disallow /hvide-kitler.html
Disallow /klinikdriver-733589.html
Disallow /klinikdriver.html
Disallow /brancher.html
Disallow /content-218108.html
Disallow /content2.html
Disallow /content3.html

Other Records

Field Value
sitemap https://www.hvidekitler.dk/sitemap.xml