delimburger.nl
robots.txt

Robots Exclusion Standard data for delimburger.nl

Resource Scan

Scan Details

Site Domain delimburger.nl
Base Domain delimburger.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-03T07:20:04+00:00
Next Scan 2024-08-01T07:20:04+00:00

Last Successful Scan

Scanned2023-04-10T05:07:11+00:00
URL https://delimburger.nl/robots.txt
Redirect https://www.limburger.nl/robots.txt
Redirect Domain www.limburger.nl
Redirect Base limburger.nl
Domain IPs 104.21.24.188, 172.67.219.233, 2606:4700:3031::6815:18bc, 2606:4700:3031::ac43:dbe9
Redirect IPs 104.18.16.84, 104.18.17.84, 2606:4700::6812:1054, 2606:4700::6812:1154
Response IP 104.18.16.84
Found Yes
Hash 135e0f73a39914c6a35dfb0d4a10860cc7be219c34ad37d8795a06359a8e8b97
SimHash 9c3c6608dbd2

Groups

*

Rule Path
Disallow /limnl/
Disallow /limnl-mobile/
Disallow /messagent/
Disallow /extra/messagent/
Disallow /utils/
Disallow /account/
Disallow /LoadTest/
Disallow /api/