Log In Sign Up

hip.dk
robots.txt

Robots Exclusion Standard data for hip.dk

Resource Scan

Scan Details

Site Domain hip.dk
Base Domain hip.dk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-22T07:34:10+00:00
Next Scan 2026-03-22T07:34:10+00:00

Last Successful Scan

Scanned2025-05-03T15:53:58+00:00
URL https://hip.dk/robots.txt
Redirect https://www.sn.dk/robots.txt
Redirect Domain www.sn.dk
Redirect Base sn.dk
Domain IPs 13.51.211.71, 16.170.177.105
Redirect IPs 18.172.112.44, 18.172.112.58, 18.172.112.63, 18.172.112.85, 2600:9000:269a:3800:1b:8f54:4e80:93a1, 2600:9000:269a:4400:1b:8f54:4e80:93a1, 2600:9000:269a:6600:1b:8f54:4e80:93a1, 2600:9000:269a:8200:1b:8f54:4e80:93a1, 2600:9000:269a:bc00:1b:8f54:4e80:93a1, 2600:9000:269a:e000:1b:8f54:4e80:93a1, 2600:9000:269a:e00:1b:8f54:4e80:93a1, 2600:9000:269a:ea00:1b:8f54:4e80:93a1
Response IP 18.165.122.5
Found Yes
Hash 7d7b181034cfd98d2b88e869ef8300e67afc2326d6ab91cfe1355e2a12e737c8
SimHash 50149070c525

Groups

*

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

eyeotabot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.sn.dk/SitemapIndex.0.xml
Back to top

Comments

  • AI crawler reference
  • The link below provides instructions to what kind of content can be used to train AI models on this website
  • https://sn.dk/ai.txt
  • Common crawl
  • OpenAI (ChatGPT)
  • OpenAI (ChatGPT realtime search)
  • Anthropic
  • adsense
Back to top