version2.dk
robots.txt

Robots Exclusion Standard data for version2.dk

Resource Scan

Scan Details

Site Domain version2.dk
Base Domain version2.dk
Scan Status Ok
Last Scan2025-11-11T08:51:33+00:00
Next Scan 2025-11-25T08:51:33+00:00

Last Scan

Scanned2025-11-11T08:51:33+00:00
URL https://version2.dk/robots.txt
Redirect https://www.version2.dk/robots.txt
Redirect Domain www.version2.dk
Redirect Base version2.dk
Domain IPs 34.102.188.132
Redirect IPs 34.102.188.132
Response IP 34.102.188.132
Found Yes
Hash e4378306175ed500292eb0b14ab2fe77d986c38ddd22eda56b5412d3125e27e9
SimHash 348cbd41a6c0

Groups

*

Rule Path
Allow /core/*.css$
Allow /core/*.css?
Allow /core/*.js$
Allow /core/*.js?
Allow /core/*.gif
Allow /core/*.jpg
Allow /core/*.jpeg
Allow /core/*.png
Allow /core/*.svg
Allow /profiles/*.css$
Allow /profiles/*.css?
Allow /profiles/*.js$
Allow /profiles/*.js?
Allow /profiles/*.gif
Allow /profiles/*.jpg
Allow /profiles/*.jpeg
Allow /profiles/*.png
Allow /profiles/*.svg
Disallow /core/
Disallow /profiles/
Disallow /README.txt
Disallow /web.config
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips
Disallow /node/add/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /media/oembed
Disallow /*/media/oembed
Disallow /index.php/admin/
Disallow /index.php/comment/reply/
Disallow /index.php/filter/tips
Disallow /index.php/node/add/
Disallow /index.php/search/
Disallow /index.php/user/password/
Disallow /index.php/user/register/
Disallow /index.php/user/login/
Disallow /index.php/user/logout/
Disallow /index.php/media/oembed
Disallow /index.php/*/media/oembed
Disallow /user/register?destination=*
Disallow /user/login?destination=*
Disallow /comments/*
Disallow /comment/*
Disallow /yikes/pixel.gif*
Disallow /login?*
Disallow /login*
Disallow /register*
Disallow /user/login*
Disallow /user/register*
Disallow /bruger/*
Disallow /cookiedeklaration*
Disallow /kontakt*

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

adsbot-google
amazonbot
anthropic-ai
applebot
awariorssbot
awariosmartbot
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
dataforseobot
diffbot
facebookbot
friendlycrawler
google-extended
googleother
gptbot
img2dataset
imagesiftbot
magpie-crawler
meltwater
omgili
omgilibot
peer39_crawler
peer39_crawler/1.0
perplexitybot
piplbot
scoop.it
seekr
youbot
sentibot
dotbot
barkrowler

Rule Path
Disallow /

meta-externalagent
meta-externalfetcher
oai-searchbot
perplexity-user
applebot-extended

Rule Path
Disallow /

facebookexternalhit

Rule Path
Allow /

Comments

  • CSS, JS, Images
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Added 2022-03-10
  • MI-5493
  • disallow bots
  • Disallow AI Crawlers - From the list https://github.com/ai-robots-txt/ai.robots.txt/blob/main/robots.txt
  • Added 2025-08-08: AI-specific controls
  • Ensure social previews still work