femina.dk
robots.txt

Robots Exclusion Standard data for femina.dk

Resource Scan

Scan Details

Site Domain femina.dk
Base Domain femina.dk
Scan Status Ok
Last Scan2024-09-17T14:27:27+00:00
Next Scan 2024-09-24T14:27:27+00:00

Last Scan

Scanned2024-09-17T14:27:27+00:00
URL https://femina.dk/robots.txt
Redirect https://www.femina.dk/robots.txt
Redirect Domain www.femina.dk
Redirect Base femina.dk
Domain IPs 104.18.39.154, 172.64.148.102, 2606:4700:4400::6812:279a, 2606:4700:4400::ac40:9466
Redirect IPs 108.157.254.117, 108.157.254.118, 108.157.254.68, 108.157.254.85, 2600:9000:2753:3a00:1f:72de:bec0:93a1, 2600:9000:2753:400:1f:72de:bec0:93a1, 2600:9000:2753:5800:1f:72de:bec0:93a1, 2600:9000:2753:6a00:1f:72de:bec0:93a1, 2600:9000:2753:8800:1f:72de:bec0:93a1, 2600:9000:2753:c800:1f:72de:bec0:93a1, 2600:9000:2753:ca00:1f:72de:bec0:93a1, 2600:9000:2753:cc00:1f:72de:bec0:93a1
Response IP 108.157.254.68
Found Yes
Hash dafcc3c450a3f6e882f12f57e461bd0069c86b067098163ce396fd4cf65d1bd4
SimHash 260fda40ed30

Groups

*

Rule Path
Allow /_nuxt/*.css$
Allow /_nuxt/*.css?
Allow /_nuxt/*.js$
Allow /_nuxt/*.js?

googlebot

Rule Path
Allow *.js
Allow *.css

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://femina.dk/sitemap.xml

Comments

  • robots.txt
  • CSS, JS, Images
  • Googlebot
  • PROTECT FROM CLONER