doublechinburgers.com
robots.txt

Robots Exclusion Standard data for doublechinburgers.com

Resource Scan

Scan Details

Site Domain doublechinburgers.com
Base Domain doublechinburgers.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-05-29T03:51:38+00:00
Next Scan 2024-06-05T03:51:38+00:00

Last Successful Scan

Scanned2023-09-08T20:55:24+00:00
URL https://www.doublechinburgers.com/robots.txt
Domain IPs 152.199.39.108, 2606:2800:247:1cb7:261b:1f9c:2074:3c
Response IP 152.199.39.108
Found Yes
Hash e204305962691ac1af32ae6ac7985f85b2790c47f8a2828eaea3b74e6ae6d095
SimHash c8019a0203b2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://doublechinburgers.com/sitemap.xml
sitemap https://doublechinburgers.com/news-sitemap.xml