hetbelangvanlimburg.be
robots.txt

Robots Exclusion Standard data for hetbelangvanlimburg.be

Resource Scan

Scan Details

Site Domain hetbelangvanlimburg.be
Base Domain hetbelangvanlimburg.be
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-11T16:08:23+00:00
Next Scan 2024-09-25T16:08:23+00:00

Last Successful Scan

Scanned2023-04-10T15:40:44+00:00
URL http://hetbelangvanlimburg.be/robots.txt
Redirect https://www.hbvl.be/robots.txt
Redirect Domain www.hbvl.be
Redirect Base hbvl.be
Domain IPs 185.43.124.33
Redirect IPs 104.17.98.51, 104.17.99.51, 2606:4700::6811:6233, 2606:4700::6811:6333
Response IP 104.17.99.51
Found Yes
Hash 3aada6a2600ba8978c08921c5b22917a8998c8632a3bd5d81f354fa12ed9ce3c
SimHash 8d7c464ad9d2

Groups

*

Rule Path
Disallow /hbvl/
Disallow /hbvl-mobile/
Disallow /messagent/
Disallow /extra/messagent/
Disallow /utils/
Disallow /account/
Disallow /LoadTest/
Disallow /api/