bestbargains.com
robots.txt
Robots Exclusion Standard data for bestbargains.com
Resource Scan
Scan Details
| Site Domain | bestbargains.com |
| Base Domain | bestbargains.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-08-29T03:58:09+00:00 |
| Next Scan | 2024-11-27T03:58:09+00:00 |
Last Successful Scan
| Scanned | 2023-08-06T03:14:40+00:00 |
| URL | https://www.bestbargains.com/robots.txt |
| Domain IPs | 2600:9000:2003:2600:8:48e3:a780:93a1, 2600:9000:2003:2a00:8:48e3:a780:93a1, 2600:9000:2003:2c00:8:48e3:a780:93a1, 2600:9000:2003:2e00:8:48e3:a780:93a1, 2600:9000:2003:4c00:8:48e3:a780:93a1, 2600:9000:2003:c00:8:48e3:a780:93a1, 2600:9000:2003:d400:8:48e3:a780:93a1, 2600:9000:2003:f200:8:48e3:a780:93a1, 54.192.150.105, 54.192.150.120, 54.192.150.26, 54.192.150.74 |
| Response IP | 54.192.150.105 |
| Found | Yes |
| Hash | c36038f68d31ed8131910e30c74bf61cafed0157138de412d1697facdbca96dd |
| SimHash | 2400d0c05592 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /click_ad |
| Disallow | /clk_ad |
| Disallow | /wr_clk |
Comments