money.yahoo.com
robots.txt

Robots Exclusion Standard data for money.yahoo.com

Resource Scan

Scan Details

Site Domain money.yahoo.com
Base Domain yahoo.com
Scan Status Ok
Last Scan2024-11-07T08:56:20+00:00
Next Scan 2024-11-21T08:56:20+00:00

Last Scan

Scanned2024-11-07T08:56:20+00:00
URL https://money.yahoo.com/robots.txt
Domain IPs 202.165.107.57, 2406:2000:e4:1404::1:2000
Response IP 202.165.107.57
Found Yes
Hash 14086f618a712150515ac632a62b7077a712a77a05d20e9ed8aa7adca9ba19bf
SimHash ec0d8b508551

Groups

*

Rule Path
Disallow /__rapidworker-1.2.js
Disallow /_td_api
Disallow /_td
Disallow /_pf_money

Other Records

Field Value
sitemap https://money.yahoo.com/sitemaps/money-sitemap_index_US_en-US.xml.gz
sitemap https://money.yahoo.com/sitemaps/money-sitemap_articles_US_en-US.xml.gz
sitemap https://money.yahoo.com/sitemaps/money-sitemap_videos_US_en-US.xml.gz
sitemap https://money.yahoo.com/sitemaps/money-sitemap_googlenews_US_en-US.xml.gz