Log In Sign Up

lessportsplus.dhnet.be
robots.txt

Robots Exclusion Standard data for lessportsplus.dhnet.be

Resource Scan

Scan Details

Site Domain lessportsplus.dhnet.be
Base Domain dhnet.be
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan4/5/2025, 2:08:29 PM
Next Scan 4/19/2025, 2:08:29 PM

Last Successful Scan

Scanned3/21/2025, 9:54:16 AM
URL https://lessportsplus.dhnet.be/robots.txt
Domain IPs 23.209.46.20, 23.209.46.6, 2600:1413:b000:13::b857:c187, 2600:1413:b000:13::b857:c19b
Response IP 23.45.207.173
Found Yes
Hash d86283069045b656736c8c6834fce51b75f18476ad6a5157184e98135cd9bb3d
SimHash 241f5a588435

Groups

*

Rule Path
Disallow /apc.php
Disallow /partners/
Disallow /phpinfo.php
Disallow /preview/
Disallow /pub/
Disallow /recherche
Disallow /profil
Disallow /redirect/
Disallow /status/
Disallow /test/
Disallow /edition-abonne
Disallow /podcast
Disallow /undefined.html
Disallow *gclid%3D
Disallow /pf/resources/dist/fonts/*
Disallow /pf/resources/dist/images/*
Disallow /pf/resources/plugins/*
Disallow /pf/api/*
Disallow /*outputType%3Dandroid
Disallow /*outputType%3Dios
Disallow /*outputType%3Dapp

googlebot

Rule Path
Disallow *utm_

mediapartners-google

Rule Path
Allow /

adequat

Rule Path
Disallow /

adequat-systems

Rule Path
Disallow /

amisoftware

Rule Path
Disallow /

argus

Rule Path
Disallow /

ask n read

Rule Path
Disallow /

asknread.com

Rule Path
Disallow /

augure

Rule Path
Disallow /

auramundi

Rule Path
Disallow /

bloodhound

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

cision

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

coexel

Rule Path
Disallow /

converacrawler

Rule Path
Disallow /

corporama

Rule Path
Disallow /

cydralspider

Rule Path
Disallow /

digimind

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

downloadexpress

Rule Path
Disallow /

edd

Rule Path
Disallow /

ellisphere

Rule Path
Disallow /

eureka

Rule Path
Disallow /

europresse

Rule Path
Disallow /

explore

Rule Path
Disallow /

factiva

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

fetch

Rule Path
Disallow /

firstrain

Rule Path
Disallow /

gammaspider

Rule Path
Disallow /

gnowitnewsbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

indexer

Rule Path
Disallow /

infoseek

Rule Path
Disallow /

jetbot

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

kantar

Rule Path
Disallow /

kbcrawl

Rule Path
Disallow /

knowings

Rule Path
Disallow /

larbin

Rule Path
Disallow /

leadbox

Rule Path
Disallow /

libwww

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

linko

Rule Path
Disallow /

manageo

Rule Path
Disallow /

maxpointcrawler

Rule Path
Disallow /

mediacompil

Rule Path
Disallow /

meltawer

Rule Path
Disallow /

meltwater

Rule Path
Disallow /

mention

Rule Path
Disallow /

moreover

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

mytwip

Rule Path
Disallow /

newscan-online

Rule Path
Disallow /

newsnow

Rule Path
Disallow /

newzbin

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

objectssearch

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

opinion-tracker

Rule Path
Disallow /

pimptrain

Rule Path
Disallow /

proxem

Rule Path
Disallow /

quepasacreep

Rule Path
Disallow /

qwam content intelligence

Rule Path
Disallow /

raven

Rule Path
Disallow /

readability.com

Rule Path
Disallow /

riddler

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

scoop.it

Rule Path
Disallow /

score3

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

sindup

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

spotter

Rule Path
Disallow /

synthesio

Rule Path
Disallow /

talkwater

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

trendeo

Rule Path
Disallow /

trendybuzz

Rule Path
Disallow /

tunitinbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

up2news

Rule Path
Disallow /

vecteurplus

Rule Path
Disallow /

verif

Rule Path
Disallow /

verticalsearch

Rule Path
Disallow /

vsw

Rule Path
Disallow /

wapspider

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzinger

Rule Path
Disallow /

webzip

Rule Path
Disallow /

winello

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

youmag

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

zite

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.dhnet.be/arc/outboundfeeds/sitemap-index/?outputType=xml
sitemap https://www.dhnet.be/arc/outboundfeeds/sitemap-index/news/?outputType=xml
sitemap https://www.dhnet.be/arc/outboundfeeds/sitemap-news/?outputType=xml
sitemap https://www.dhnet.be/arc/outboundfeeds/sitemap-section/?outputType=xml
Back to top

Comments

  • Sitemaps
  • Disallow some files and directories for all bots
  • Disallow *utm for google
  • Allow Mediapartners-Google *
  • Disallow undesired bots
Back to top

Warnings

  • 4 invalid lines.
Back to top