starchannel.be
robots.txt
Robots Exclusion Standard data for starchannel.be
Resource Scan
Scan Details
| Site Domain | starchannel.be |
| Base Domain | starchannel.be |
| Scan Status | Ok |
| Last Scan | 2024-11-13T11:56:58+00:00 |
| Next Scan | 2024-11-20T11:56:58+00:00 |
Last Scan
| Scanned | 2024-11-13T11:56:58+00:00 |
| URL | https://starchannel.be/robots.txt |
| Domain IPs | 37.59.93.230 |
| Response IP | 37.59.93.230 |
| Found | Yes |
| Hash | c8c5ffe4563317553775f6f50db7d3e85f731c9db586b9c37abbd51c5cda23b2 |
| SimHash | 6c15d862e613 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /$ |
| Allow | /programmas |
| Allow | /tv-gids |
| Allow | /special |
| Allow | /info |
| Allow | /contact |
| Allow | /videos |
| Allow | /recipe |
| Allow | /sitemap.xml |
| Allow | /sitemap-video.xml |
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.starchannel.be/sitemap.xml |
| sitemap | https://www.starchannel.be/sitemap-video.xml |
Comments