dbufyn.dk
robots.txt

Robots Exclusion Standard data for dbufyn.dk

Resource Scan

Scan Details

Site Domain dbufyn.dk
Base Domain dbufyn.dk
Scan Status Ok
Last Scan2024-06-19T09:51:42+00:00
Next Scan 2024-06-26T09:51:42+00:00

Last Scan

Scanned2024-06-19T09:51:42+00:00
URL https://dbufyn.dk/robots.txt
Domain IPs 104.19.191.28
Response IP 104.19.191.28
Found Yes
Hash 4fa572d2e03ef8bbb3fe0e346d3795d3f03de94ec2906e2e88981aabc373f4f9
SimHash 011cbc42ee10

Groups

*

Rule Path
Disallow /aspnet_client/
Disallow /bin/
Disallow /config/
Disallow /data/
Disallow /install/
Disallow /masterpages/
Disallow /python/
Disallow /umbraco/
Disallow /umbraco_client/
Disallow /usercontrols/
Disallow /xslt/
Disallow /turneringer_og_resultater/resultatsoegning/
Disallow /landshold/landsholdsdatabasen/*.aspx*
Disallow /resultater/kampsoegAdvanceret/

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mozilla/5.0 (compatible; grapeshotcrawler/2.0; http://www.grapeshot.co.uk/crawler.php)

Rule Path
Disallow /

mozilla/5.0 (compatible; proximic; https://www.comscore.com/web-crawler)

Rule Path
Disallow /

perl lwp

Rule Path
Disallow /

Other Records

Field Value
sitemap /xmlsitemap