store.com
robots.txt
Robots Exclusion Standard data for store.com
Resource Scan
Scan Details
| Site Domain | store.com |
| Base Domain | store.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-03-03T15:22:22+00:00 |
| Next Scan | 2024-06-01T15:22:22+00:00 |
Last Successful Scan
| Scanned | 2023-08-07T11:17:29+00:00 |
| URL | https://www.store.com/robots.txt |
| Domain IPs | 13.33.33.10, 13.33.33.29, 13.33.33.3, 13.33.33.75, 2600:9000:229f:3c00:13:1f84:2a40:93a1, 2600:9000:229f:4000:13:1f84:2a40:93a1, 2600:9000:229f:7200:13:1f84:2a40:93a1, 2600:9000:229f:7a00:13:1f84:2a40:93a1, 2600:9000:229f:a000:13:1f84:2a40:93a1, 2600:9000:229f:aa00:13:1f84:2a40:93a1, 2600:9000:229f:be00:13:1f84:2a40:93a1, 2600:9000:229f:e800:13:1f84:2a40:93a1 |
| Response IP | 13.33.33.3 |
| Found | Yes |
| Hash | c36038f68d31ed8131910e30c74bf61cafed0157138de412d1697facdbca96dd |
| SimHash | 2400d0c05592 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /click_ad |
| Disallow | /clk_ad |
| Disallow | /wr_clk |
Comments