designlist.com
robots.txt
Robots Exclusion Standard data for designlist.com
Resource Scan
Scan Details
Site Domain | designlist.com |
Base Domain | designlist.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-08-29T08:26:05+00:00 |
Next Scan | 2024-11-27T08:26:05+00:00 |
Last Successful Scan
Scanned | 2023-08-06T07:11:21+00:00 |
URL | https://www.designlist.com/robots.txt |
Domain IPs | 13.33.33.108, 13.33.33.114, 13.33.33.24, 13.33.33.68, 2600:9000:229f:0:c:6923:c000:93a1, 2600:9000:229f:5e00:c:6923:c000:93a1, 2600:9000:229f:8000:c:6923:c000:93a1, 2600:9000:229f:8400:c:6923:c000:93a1, 2600:9000:229f:b600:c:6923:c000:93a1, 2600:9000:229f:c600:c:6923:c000:93a1, 2600:9000:229f:e800:c:6923:c000:93a1, 2600:9000:229f:ee00:c:6923:c000:93a1 |
Response IP | 13.33.33.114 |
Found | Yes |
Hash | c36038f68d31ed8131910e30c74bf61cafed0157138de412d1697facdbca96dd |
SimHash | 2400d0c05592 |
Groups
*
Rule | Path |
---|---|
Disallow | /api |
Disallow | /click_ad |
Disallow | /clk_ad |
Disallow | /wr_clk |
Comments