yahoosports.com
robots.txt

Robots Exclusion Standard data for yahoosports.com

Resource Scan

Scan Details

Site Domain yahoosports.com
Base Domain yahoosports.com
Scan Status Ok
Last Scan2024-05-18T08:41:59+00:00
Next Scan 2024-06-01T08:41:59+00:00

Last Scan

Scanned2024-05-18T08:41:59+00:00
URL https://yahoosports.com/robots.txt
Redirect https://sports.yahoo.com/robots.txt
Redirect Domain sports.yahoo.com
Redirect Base yahoo.com
Domain IPs 13.248.158.7, 76.223.84.192
Redirect IPs 106.10.236.37, 106.10.236.40, 180.222.114.11, 180.222.114.12, 2406:2000:98:800::e5, 2406:2000:98:800::e6, 2406:2000:e4:1604::1000, 2406:2000:e4:1604::1001
Response IP 180.222.116.11
Found Yes
Hash 821fddca9f3c0c28f1714f23702a05d8c6ac8a0a8e3951a3a5336488ce860053
SimHash 3814cc5ce391

Groups

*

Rule Path
Disallow /_x_/
Disallow /_xhr/
Disallow /site/
Disallow /nel_ms/
Disallow /darla/
Disallow /dynamic/
Disallow /pageview/
Disallow /fp_ms/

Other Records

Field Value
sitemap https://sports.yahoo.com/dailyfantasy/sitemaps/dailyfantasy-sitemap_index_US_en-US.xml.gz
sitemap https://sports.yahoo.com/sitemap-index.xml
sitemap https://sports.yahoo.com/news-sitemap-index.xml
sitemap https://sports.yahoo.com/teams-sitemap-index.xml
sitemap https://sports.yahoo.com/players-sitemap-index.xml