loberon.be
robots.txt

Robots Exclusion Standard data for loberon.be

Resource Scan

Scan Details

Site Domain loberon.be
Base Domain loberon.be
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-04T01:43:31+00:00
Next Scan 2025-11-03T01:43:31+00:00

Last Successful Scan

Scanned2025-08-12T19:32:11+00:00
URL https://loberon.be/robots.txt
Redirect https://www.loberon.be/robots.txt
Redirect Domain www.loberon.be
Redirect Base loberon.be
Domain IPs 116.202.199.129, 5.9.34.36
Redirect IPs 116.202.199.129, 5.9.34.36
Response IP 116.202.199.129
Found Yes
Hash ac8fe8ea0b98b5aac6f848ddfd08f12b068f5605a70a3026dd5197a87cc8dd76
SimHash 63155c21e535

Groups

*

Rule Path
Disallow /admin/
Disallow /*.carousel

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.7

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

amazonbot

Rule Path
Disallow *

Other Records

Field Value
crawl-delay 0.7

Other Records

Field Value
sitemap https://www.loberon.be/nl/sitemap.xml
sitemap https://www.loberon.be/fr/sitemap.xml