billedbladet.dk
robots.txt

Robots Exclusion Standard data for billedbladet.dk

Resource Scan

Scan Details

Site Domain billedbladet.dk
Base Domain billedbladet.dk
Scan Status Ok
Last Scan2024-11-14T09:07:31+00:00
Next Scan 2024-11-21T09:07:31+00:00

Last Scan

Scanned2024-11-14T09:07:31+00:00
URL https://billedbladet.dk/robots.txt
Redirect https://www.billedbladet.dk/robots.txt
Redirect Domain www.billedbladet.dk
Redirect Base billedbladet.dk
Domain IPs 104.18.42.132, 172.64.145.124, 2606:4700:4400::6812:2a84, 2606:4700:4400::ac40:917c
Redirect IPs 13.33.88.37, 13.33.88.81, 13.33.88.84, 13.33.88.9, 2600:9000:223b:3800:18:d180:a700:93a1, 2600:9000:223b:5a00:18:d180:a700:93a1, 2600:9000:223b:600:18:d180:a700:93a1, 2600:9000:223b:7600:18:d180:a700:93a1, 2600:9000:223b:7c00:18:d180:a700:93a1, 2600:9000:223b:9600:18:d180:a700:93a1, 2600:9000:223b:a200:18:d180:a700:93a1, 2600:9000:223b:a600:18:d180:a700:93a1
Response IP 13.33.88.81
Found Yes
Hash 14a323ebadc8a26d94cfc60fddbf5bfda566aaca53c776d274e3ba6de6586ab7
SimHash 264fda40ed30

Groups

*

Rule Path
Allow /_nuxt/*.css$
Allow /_nuxt/*.css?
Allow /_nuxt/*.js$
Allow /_nuxt/*.js?

googlebot

Rule Path
Allow *.js
Allow *.css

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://www.billedbladet.dk/sitemap.xml

Comments

  • robots.txt
  • CSS, JS, Images
  • Googlebot
  • PROTECT FROM CLONER