money.yahoo.com
robots.txt
Robots Exclusion Standard data for money.yahoo.com
Resource Scan
Scan Details
Site Domain | money.yahoo.com |
Base Domain | yahoo.com |
Scan Status | Ok |
Last Scan | 2024-11-07T08:56:20+00:00 |
Next Scan | 2024-11-21T08:56:20+00:00 |
Last Scan
Scanned | 2024-11-07T08:56:20+00:00 |
URL | https://money.yahoo.com/robots.txt |
Domain IPs | 202.165.107.57, 2406:2000:e4:1404::1:2000 |
Response IP | 202.165.107.57 |
Found | Yes |
Hash | 14086f618a712150515ac632a62b7077a712a77a05d20e9ed8aa7adca9ba19bf |
SimHash | ec0d8b508551 |
Groups
*
Rule | Path |
---|---|
Disallow | /__rapidworker-1.2.js |
Disallow | /_td_api |
Disallow | /_td |
Disallow | /_pf_money |
Other Records
Field | Value |
---|---|
sitemap | https://money.yahoo.com/sitemaps/money-sitemap_index_US_en-US.xml.gz |
sitemap | https://money.yahoo.com/sitemaps/money-sitemap_articles_US_en-US.xml.gz |
sitemap | https://money.yahoo.com/sitemaps/money-sitemap_videos_US_en-US.xml.gz |
sitemap | https://money.yahoo.com/sitemaps/money-sitemap_googlenews_US_en-US.xml.gz |