doublelist.com
robots.txt

Robots Exclusion Standard data for doublelist.com

Resource Scan

Scan Details

Site Domain doublelist.com
Base Domain doublelist.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-01-29T05:33:54+00:00
Next Scan 2025-04-29T05:33:54+00:00

Last Successful Scan

Scanned2023-01-02T20:40:49+00:00
URL https://doublelist.com/robots.txt
Domain IPs 151.139.128.10
Response IP 151.139.128.10
Found Yes
Hash 1dd9eb2318fe5937ce84faeb3540abb5c23dc76f4d6535427c85aef14df8c0c4
SimHash 950b46054112

Groups

*

Rule Path
Disallow /ads/
Disallow /posts/
Disallow /content_images/
Disallow /cached_pages_tmp/
Disallow /cached_pages_tmp_new/
Disallow /email_imgs/
Disallow /ad_manager/
Disallow /out/
Disallow /email/