carshots.com
robots.txt
Robots Exclusion Standard data for carshots.com
Resource Scan
Scan Details
Site Domain | carshots.com |
Base Domain | carshots.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-08-27T03:16:07+00:00 |
Next Scan | 2024-11-25T03:16:07+00:00 |
Last Successful Scan
Scanned | 2023-08-03T20:04:32+00:00 |
URL | https://www.carshots.com/robots.txt |
Domain IPs | 2600:9000:20c7:1000:14:98fe:a440:93a1, 2600:9000:20c7:3600:14:98fe:a440:93a1, 2600:9000:20c7:3800:14:98fe:a440:93a1, 2600:9000:20c7:7000:14:98fe:a440:93a1, 2600:9000:20c7:7600:14:98fe:a440:93a1, 2600:9000:20c7:ba00:14:98fe:a440:93a1, 2600:9000:20c7:d200:14:98fe:a440:93a1, 2600:9000:20c7:d400:14:98fe:a440:93a1, 52.84.251.18, 52.84.251.74, 52.84.251.83, 52.84.251.98 |
Response IP | 108.138.7.115 |
Found | Yes |
Hash | c36038f68d31ed8131910e30c74bf61cafed0157138de412d1697facdbca96dd |
SimHash | 2400d0c05592 |
Groups
*
Rule | Path |
---|---|
Disallow | /api |
Disallow | /click_ad |
Disallow | /clk_ad |
Disallow | /wr_clk |
Comments