katalogvirksomheder.dk
robots.txt

Robots Exclusion Standard data for katalogvirksomheder.dk

Resource Scan

Scan Details

Site Domain katalogvirksomheder.dk
Base Domain katalogvirksomheder.dk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-21T21:09:26+00:00
Next Scan 2025-01-19T21:09:26+00:00

Last Successful Scan

Scanned2024-03-26T19:39:25+00:00
URL https://katalogvirksomheder.dk/robots.txt
Domain IPs 104.21.39.164, 172.67.146.195, 2606:4700:3031::6815:27a4, 2606:4700:3032::ac43:92c3
Response IP 104.21.39.164
Found Yes
Hash 6794ba16245940262babf6122963c75a07b8bf7bf6fb686109debb633b4a8c60
SimHash 65954856c397

Groups

*

Rule Path
Disallow /admin/

bingbot

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 25

Other Records

Field Value
sitemap http://katalogvirksomheder.dk/sitemap.xml
sitemap https://katalogvirksomheder.dk/alle-svar/sitemap-index.xml
sitemap http://katalogvirksomheder.dk/sitemap.xml
sitemap https://katalogvirksomheder.dk/alle-svar/sitemap-index.xml