fiskekalenderen.dk
robots.txt

Robots Exclusion Standard data for fiskekalenderen.dk

Resource Scan

Scan Details

Site Domain fiskekalenderen.dk
Base Domain fiskekalenderen.dk
Scan Status Ok
Last Scan2025-05-14T03:30:40+00:00
Next Scan 2025-05-21T03:30:40+00:00

Last Scan

Scanned2025-05-14T03:30:40+00:00
URL https://fiskekalenderen.dk/robots.txt
Domain IPs 104.26.8.193, 104.26.9.193, 172.67.75.178, 2606:4700:20::681a:8c1, 2606:4700:20::681a:9c1, 2606:4700:20::ac43:4bb2
Response IP 104.26.8.193
Found Yes
Hash 05ef527dbba283e800169d08e244536aa0bb5d1b9d7959e81c2b0983a509d5fd
SimHash 2b18d90de022

Groups

*

Rule Path
Disallow /ajax/*
Disallow /backend/*
Disallow /include/*
Disallow /widgets/*
Disallow /subdomains/*
Disallow /import/*

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

kinsta-bot

Rule Path
Disallow /

neticle crawler

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

Comments

  • enjoy
  • kill