vielskerserier.dk
robots.txt

Robots Exclusion Standard data for vielskerserier.dk

Resource Scan

Scan Details

Site Domain vielskerserier.dk
Base Domain vielskerserier.dk
Scan Status Ok
Last Scan2024-05-08T04:54:48+00:00
Next Scan 2024-05-15T04:54:48+00:00

Last Scan

Scanned2024-05-08T04:54:48+00:00
URL https://vielskerserier.dk/robots.txt
Domain IPs 104.18.8.70, 104.18.9.70, 2606:4700::6812:846, 2606:4700::6812:946
Response IP 104.18.8.70
Found Yes
Hash 006857def53488317419311dc779d9d256d4a40a5b45a435a7950f1f3f6ce903
SimHash 260fda40ed70

Groups

*

Rule Path
Allow /_nuxt/*.css$
Allow /_nuxt/*.css?
Allow /_nuxt/*.js$
Allow /_nuxt/*.js?

googlebot

Rule Path
Allow *.js
Allow *.css

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /
Disallow /cdn-cgi/

Other Records

Field Value
sitemap https://vielskerserier.dk/sitemap.xml

Comments

  • robots.txt
  • CSS, JS, Images
  • Googlebot
  • PROTECT FROM CLONER