foxtv.be
robots.txt
Robots Exclusion Standard data for foxtv.be
Resource Scan
Scan Details
| Site Domain | foxtv.be |
| Base Domain | foxtv.be |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-08-28T22:38:20+00:00 |
| Next Scan | 2024-11-26T22:38:20+00:00 |
Last Successful Scan
| Scanned | 2024-02-01T22:29:52+00:00 |
| URL | https://foxtv.be/robots.txt |
| Domain IPs | 178.32.88.217 |
| Response IP | 178.32.88.217 |
| Found | Yes |
| Hash | c8c5ffe4563317553775f6f50db7d3e85f731c9db586b9c37abbd51c5cda23b2 |
| SimHash | 6c15d862e613 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /$ |
| Allow | /programmas |
| Allow | /tv-gids |
| Allow | /special |
| Allow | /info |
| Allow | /contact |
| Allow | /videos |
| Allow | /recipe |
| Allow | /sitemap.xml |
| Allow | /sitemap-video.xml |
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.starchannel.be/sitemap.xml |
| sitemap | https://www.starchannel.be/sitemap-video.xml |
Comments