forbes.be
robots.txt
Robots Exclusion Standard data for forbes.be
Resource Scan
Scan Details
| Site Domain | forbes.be |
| Base Domain | forbes.be |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-11-21T01:45:49+00:00 |
| Next Scan | 2025-12-21T01:45:49+00:00 |
Last Successful Scan
| Scanned | 2025-10-21T18:46:28+00:00 |
| URL | https://forbes.be/robots.txt |
| Redirect | https://www.forbes.be/robots.txt |
| Redirect Domain | www.forbes.be |
| Redirect Base | forbes.be |
| Domain IPs | 104.21.76.199, 172.67.200.47, 2606:4700:3030::ac43:c82f, 2606:4700:3033::6815:4cc7 |
| Redirect IPs | 104.21.76.199, 172.67.200.47, 2606:4700:3030::ac43:c82f, 2606:4700:3033::6815:4cc7 |
| Response IP | 104.21.76.199 |
| Found | Yes |
| Hash | 59b2faa96472f511bad2276d57805586f52867eb169b497c7baf054b7e7bc8b7 |
| SimHash | 40089145a5f3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /fr/wp-login.php |
| Disallow | /nl/wp-login.php |
| Disallow | /fr/?s= |
| Disallow | /nl/?s= |
| Disallow | /search/ |
| Disallow | /fr/search/ |
| Disallow | /nl/search/ |
| Disallow | /fr/wp-admin/ |
| Disallow | /nl/wp-admin/ |
| Disallow | /nl/hub.php |
| Disallow | /nl/hub-redirect |
| Allow | /fr/wp-admin/admin-ajax.php |
| Allow | /nl/wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.forbes.be/fr/sitemap_index.xml |
| sitemap | https://www.forbes.be/fr/sitemap-news.xml |
| sitemap | https://www.forbes.be/nl/sitemap_index.xml |
| sitemap | https://www.forbes.be/nl/sitemap-news.xml |
Comments