cdn-0.askleo.com
robots.txt

Robots Exclusion Standard data for cdn-0.askleo.com

Resource Scan

Scan Details

Site Domain cdn-0.askleo.com
Base Domain askleo.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-10T13:03:02+00:00
Next Scan 2026-03-10T13:03:02+00:00

Last Successful Scan

Scanned2025-07-19T18:31:05+00:00
URL https://cdn-0.askleo.com/robots.txt
Domain IPs 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138
Response IP 52.221.42.138
Found Yes
Hash 4f37d140245b48a8660bd6f27c4511edfe2836372f6b65e49b5a005968fdeeab
SimHash 75055f15c5d3

Groups

scrapy

Rule Path
Disallow /

Other Records

Field Value
sitemap http://askleo.com/sitemap_index.xml