de.sports.yahoo.com
robots.txt
Robots Exclusion Standard data for de.sports.yahoo.com
Resource Scan
Scan Details
Site Domain | de.sports.yahoo.com |
Base Domain | yahoo.com |
Scan Status | Ok |
Last Scan | 2024-11-12T13:00:26+00:00 |
Next Scan | 2024-11-26T13:00:26+00:00 |
Last Scan
Scanned | 2024-11-12T13:00:26+00:00 |
URL | https://de.sports.yahoo.com/robots.txt |
Domain IPs | 106.10.236.37, 106.10.236.40, 180.222.114.11, 180.222.114.12, 2406:2000:98:800::e5, 2406:2000:98:800::e6, 2406:2000:e4:1604::1000, 2406:2000:e4:1604::1001 |
Response IP | 106.10.236.40 |
Found | Yes |
Hash | ac955ed8b7a438b579d345184051f29b6ae570b3329d48b24b9fa452d0e5df37 |
SimHash | 781cdd5ce7b7 |
Groups
*
Rule | Path |
---|---|
Disallow | /_x_/ |
Disallow | /_xhr/ |
Disallow | /darla/ |
Disallow | /dynamic/ |
Disallow | /pageview/ |
Other Records
Field | Value |
---|---|
sitemap | https://de.sports.yahoo.com/sitemaps/sports-sitemap_index_DE_de-DE.xml.gz |
sitemap | https://de.sports.yahoo.com/sitemaps/sports-sitemap_googlenews_DE_de-DE.xml.gz |