vennelyst.dk
robots.txt

Robots Exclusion Standard data for vennelyst.dk

Resource Scan

Scan Details

Site Domain vennelyst.dk
Base Domain vennelyst.dk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-09T01:11:20+00:00
Next Scan 2025-12-09T01:11:20+00:00

Last Successful Scan

Scanned2025-09-17T05:48:45+00:00
URL https://vennelyst.dk/robots.txt
Domain IPs 46.36.206.130
Response IP 46.36.206.130
Found Yes
Hash af93b55cb02d28523d5cd45e0d68cbb318eab1213619bd2437f03ed282301de3
SimHash c734cc464220

Groups

*
googlebot
googlebot-image
mediapartners-google
googlebot-mobile
bingbot
slurp

Rule Path
Disallow /cgi-bin
Disallow /admin
Disallow /wp-admin
Disallow /wp-login.php
Disallow /wp-content/themes/*
Disallow /wp-includes/*
Disallow /wp-content/plugins
Disallow /wp-content/plugins/
Disallow /wp-content/plugins/*
Disallow /*.php
Disallow /trackback/
Disallow /xmlrpc.php
Disallow /feed/
Disallow /tmp/
Disallow /cgi-bin/
Disallow /webalizer/
Disallow /modlogan/
Disallow /administrator/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 20

ahrefsbot
ezooms
mj12bot
xovibot

Rule Path
Disallow /