doublelist.com
robots.txt
Robots Exclusion Standard data for doublelist.com
Resource Scan
Scan Details
Site Domain | doublelist.com |
Base Domain | doublelist.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-01-29T05:33:54+00:00 |
Next Scan | 2025-04-29T05:33:54+00:00 |
Last Successful Scan
Scanned | 2023-01-02T20:40:49+00:00 |
URL | https://doublelist.com/robots.txt |
Domain IPs | 151.139.128.10 |
Response IP | 151.139.128.10 |
Found | Yes |
Hash | 1dd9eb2318fe5937ce84faeb3540abb5c23dc76f4d6535427c85aef14df8c0c4 |
SimHash | 950b46054112 |
Groups
*
Rule | Path |
---|---|
Disallow | /ads/ |
Disallow | /posts/ |
Disallow | /content_images/ |
Disallow | /cached_pages_tmp/ |
Disallow | /cached_pages_tmp_new/ |
Disallow | /email_imgs/ |
Disallow | /ad_manager/ |
Disallow | /out/ |
Disallow | /email/ |