sysco-be.com
robots.txt
Robots Exclusion Standard data for sysco-be.com
Resource Scan
Scan Details
| Site Domain | sysco-be.com |
| Base Domain | sysco-be.com |
| Scan Status | Ok |
| Last Scan | 2025-11-17T04:18:12+00:00 |
| Next Scan | 2025-12-01T04:18:12+00:00 |
Last Scan
| Scanned | 2025-11-17T04:18:12+00:00 |
| URL | https://sysco-be.com/robots.txt |
| Domain IPs | 23.100.6.247 |
| Response IP | 23.100.6.247 |
| Found | Yes |
| Hash | 36d914e9f6e9f5d2a61992e206bfdc2dc4365b0da65b79ddc21b4d90572d88fc |
| SimHash | 6ae05b8c4dfe |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cart |
| Disallow | /checkout |
| Disallow | /my-account |
| Disallow | /mentions-legales |
| Disallow | /cgv |
| Disallow | /cgu |
| Disallow | /register |
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 30 | 30 seconds between page requests |
Warnings
- `request-rate` is not a known field.
- `visit-time` is not a known field.
Comments