foxtv.ee
robots.txt
Robots Exclusion Standard data for foxtv.ee
Resource Scan
Scan Details
| Site Domain | foxtv.ee |
| Base Domain | foxtv.ee |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-08-23T05:13:21+00:00 |
| Next Scan | 2024-11-21T05:13:21+00:00 |
Last Successful Scan
| Scanned | 2024-01-27T02:44:23+00:00 |
| URL | https://foxtv.ee/robots.txt |
| Domain IPs | 37.59.93.230 |
| Response IP | 37.59.93.230 |
| Found | Yes |
| Hash | 7318a482f73e87ae73eae0f9d25be24edcc9a39ac679ce72ab32bad5e71c60fe |
| SimHash | 6912c242c333 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /$ |
| Allow | /seriaalid |
| Allow | /kavad |
| Allow | /otsing |
| Allow | /info |
| Allow | /kontakt |
| Allow | /videod |
| Allow | /recipe |
| Allow | /sitemap.xml |
| Allow | /sitemap-video.xml |
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.fxchannel.ee/sitemap.xml |
| sitemap | https://www.fxchannel.ee/sitemap-video.xml |
Comments