starchannel.nl
robots.txt
Robots Exclusion Standard data for starchannel.nl
Resource Scan
Scan Details
| Site Domain | starchannel.nl |
| Base Domain | starchannel.nl |
| Scan Status | Ok |
| Last Scan | 2024-10-31T18:07:48+00:00 |
| Next Scan | 2024-11-07T18:07:48+00:00 |
Last Scan
| Scanned | 2024-10-31T18:07:48+00:00 |
| URL | https://starchannel.nl/robots.txt |
| Domain IPs | 37.59.93.230 |
| Response IP | 37.59.93.230 |
| Found | Yes |
| Hash | 473b9a41deef2bcbf30c4f46ac63776e174fd52eb5a4219c880fbb67b594abcf |
| SimHash | 6855cc628633 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /$ |
| Allow | /programmas |
| Allow | /tv-gids |
| Allow | /special |
| Allow | /info |
| Allow | /contact |
| Allow | /videos |
| Allow | /recipe |
| Allow | /sitemap.xml |
| Allow | /sitemap-video.xml |
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.starchannel.nl/sitemap.xml |
| sitemap | https://www.starchannel.nl/sitemap-video.xml |
Comments