shopperbestbuy.com
robots.txt
Robots Exclusion Standard data for shopperbestbuy.com
Resource Scan
Scan Details
Site Domain | shopperbestbuy.com |
Base Domain | shopperbestbuy.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-09-07T04:08:27+00:00 |
Next Scan | 2024-12-06T04:08:27+00:00 |
Last Successful Scan
Scanned | 2022-11-11T18:18:26+00:00 |
URL | https://www.shopperbestbuy.com/robots.txt |
Response IP | 54.192.150.13, 54.192.150.3, 54.192.150.126, 54.192.150.85 |
Found | Yes |
Hash | c36038f68d31ed8131910e30c74bf61cafed0157138de412d1697facdbca96dd |
SimHash | 2400d0c05592 |
Groups
*
Rule | Path |
---|---|
Disallow | /api |
Disallow | /click_ad |
Disallow | /clk_ad |
Disallow | /wr_clk |
Comments