standaard.be
robots.txt
Robots Exclusion Standard data for standaard.be
Resource Scan
Scan Details
| Site Domain | standaard.be |
| Base Domain | standaard.be |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-08-13T08:15:39+00:00 |
| Next Scan | 2025-11-11T08:15:39+00:00 |
Last Successful Scan
| Scanned | 2023-04-11T01:23:53+00:00 |
| URL | https://standaard.be/robots.txt |
| Redirect | https://www.standaard.be/robots.txt |
| Redirect Domain | www.standaard.be |
| Redirect Base | standaard.be |
| Domain IPs | 185.43.124.6 |
| Redirect IPs | 104.17.77.76, 104.17.78.76, 2606:4700::6811:4d4c, 2606:4700::6811:4e4c |
| Response IP | 104.17.78.76 |
| Found | Yes |
| Hash | 3cbbdf5edd5c0630e7b0cb1761979393ffb27b4891a1d361fba8c93f8046aec8 |
| SimHash | 0c3c404cf9e2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ds-live/ |
| Disallow | /ds-mobile/ |
| Disallow | /messagent/ |
| Disallow | /extra/messagent/ |
| Disallow | /utils/ |
| Disallow | /account/ |
| Disallow | /LoadTest/ |
| Disallow | /plus/account/ |
| Disallow | /plus/login |
| Disallow | /api/ |