Log In Sign Up

vielskerserier.dk
robots.txt

Robots Exclusion Standard data for vielskerserier.dk

Resource Scan

Scan Details

Site Domain vielskerserier.dk
Base Domain vielskerserier.dk
Scan Status Ok
Last Scan2024-11-06T21:24:04+00:00
Next Scan 2024-11-13T21:24:04+00:00

Last Scan

Scanned2024-11-06T21:24:04+00:00
URL https://vielskerserier.dk/robots.txt
Domain IPs 104.18.43.247, 172.64.144.9, 2606:4700:4400::6812:2bf7, 2606:4700:4400::ac40:9009
Response IP 172.64.144.9
Found Yes
Hash 006857def53488317419311dc779d9d256d4a40a5b45a435a7950f1f3f6ce903
SimHash 260fda40ed70

Groups

*

Rule Path
Allow /_nuxt/*.css$
Allow /_nuxt/*.css?
Allow /_nuxt/*.js$
Allow /_nuxt/*.js?

googlebot

Rule Path
Allow *.js
Allow *.css

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Disallow /cdn-cgi/
Back to top

Other Records

Field Value
sitemap https://vielskerserier.dk/sitemap.xml
Back to top

Comments

  • robots.txt
  • CSS, JS, Images
  • Googlebot
  • PROTECT FROM CLONER
Back to top