foxnews.com
robots.txt
Robots Exclusion Standard data for foxnews.com
Resource Scan
Scan Details
| Site Domain | foxnews.com |
| Base Domain | foxnews.com |
| Scan Status | Ok |
| Last Scan | 2024-04-26T17:48:53+00:00 |
| Next Scan | 2024-05-03T17:48:53+00:00 |
Last Scan
| Scanned | 2024-04-26T17:48:53+00:00 |
| URL | https://foxnews.com/robots.txt |
| Redirect | https://www.foxnews.com/robots.txt |
| Redirect Domain | www.foxnews.com |
| Redirect Base | foxnews.com |
| Domain IPs | 23.53.217.76 |
| Redirect IPs | 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132, 2600:1413:b000:1b::17d7:710, 2600:1413:b000:1b::17d7:718 |
| Response IP | 23.52.171.203 |
| Found | Yes |
| Hash | a3c63d8bb7b06ea47a8b4769da9863ef5bbc5077ed74b20c138210268e7e64d4 |
| SimHash | 5d355a31b193 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search-results/ |
| Disallow | /video-search/ |
| Disallow | /printer_friendly_story/ |
| Disallow | /printer_friendly_wires/ |
| Disallow | /wires/ |
| Disallow | /xid |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.foxnews.com/sitemap.xml |
| sitemap | https://www.foxnews.com/sitemap.xml?type=news |