basketbalkrant.be
robots.txt

Robots Exclusion Standard data for basketbalkrant.be

Resource Scan

Scan Details

Site Domain basketbalkrant.be
Base Domain basketbalkrant.be
Scan Status Ok
Last Scan2026-04-02T22:52:44+00:00
Next Scan 2026-04-09T22:52:44+00:00

Last Scan

Scanned2026-04-02T22:52:44+00:00
URL https://basketbalkrant.be/robots.txt
Redirect https://www.basketbalkrant.be/robots.txt
Redirect Domain www.basketbalkrant.be
Redirect Base basketbalkrant.be
Domain IPs 2600:1901:0:d86b::, 35.227.241.68
Redirect IPs 2600:1901:0:d86b::, 35.227.241.68
Response IP 35.227.241.68
Found Yes
Hash f2bd558bef5c5c5df161dc2c0a574d63fe00c2d6bff2e6ee4aca7af9fc62a3b8
SimHash 500987315cb1

Groups

*

Rule Path
Disallow /admin
Disallow /ajax
Disallow /api
Disallow /zoeken
Disallow /*/supporter$
Disallow /nl/comments
Disallow /*/aggregate

googlebot-news

Rule Path
Allow /

msnbot

Rule Path
Disallow /admin

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

trendkite-akashic-crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.basketbalkrant.be/sitemap
sitemap https://www.basketbalkrant.be/sitemap/news