auctions.yahoo.com
robots.txt

Robots Exclusion Standard data for auctions.yahoo.com

Resource Scan

Scan Details

Site Domain auctions.yahoo.com
Base Domain yahoo.com
Scan Status Ok
Last Scan2024-11-18T08:57:25+00:00
Next Scan 2024-12-02T08:57:25+00:00

Last Scan

Scanned2024-11-18T08:57:25+00:00
URL https://auctions.yahoo.com/robots.txt
Redirect https://shopping.yahoo.com/robots.txt
Redirect Domain shopping.yahoo.com
Redirect Base yahoo.com
Domain IPs 13.248.158.7, 76.223.84.192
Redirect IPs 202.165.107.57, 2406:2000:e4:1404::1:2000
Response IP 98.137.11.157
Found Yes
Hash 893aa4e59be297031459530074c44af8e53806944811090f464c15fdc6c8bea9
SimHash c0005800c151

Groups

*

Rule Path
Disallow /graphql
Disallow /rdlw*
Disallow /tracking

bytespider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://shopping.yahoo.com/sitemap.xml