sportsday.dallasnews.com
robots.txt
Robots Exclusion Standard data for sportsday.dallasnews.com
Resource Scan
Scan Details
| Site Domain | sportsday.dallasnews.com |
| Base Domain | dallasnews.com |
| Scan Status | Ok |
| Last Scan | 2024-11-16T18:46:40+00:00 |
| Next Scan | 2024-11-23T18:46:40+00:00 |
Last Scan
| Scanned | 2024-11-16T18:46:40+00:00 |
| URL | https://sportsday.dallasnews.com/robots.txt |
| Redirect | https://www.dallasnews.com/robots.txt |
| Redirect Domain | www.dallasnews.com |
| Redirect Base | dallasnews.com |
| Domain IPs | 18.233.212.78, 3.237.59.93, 34.225.202.178, 52.0.211.88 |
| Redirect IPs | 184.87.193.74, 184.87.193.90, 2600:1413:b000:13::b857:c18e, 2600:1413:b000:13::b857:c19b |
| Response IP | 125.56.219.26 |
| Found | Yes |
| Hash | 1055b7d4e12496d93613a48da14dd2a4eebec9d8990f7a6a55db268c3c382f34 |
| SimHash | 290cd840e393 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /help/thank* |
| Disallow | /checkout/* |
| Disallow | /offers* |
| Allow | /subscribe/join/ |
| Disallow | /subscribe* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dallasnews.com/arc/outboundfeeds/sitemap-index/?outputType=xml |