lecremedelacrumb.com
robots.txt
Robots Exclusion Standard data for lecremedelacrumb.com
Resource Scan
Scan Details
| Site Domain | lecremedelacrumb.com |
| Base Domain | lecremedelacrumb.com |
| Scan Status | Ok |
| Last Scan | 2024-10-26T03:15:13+00:00 |
| Next Scan | 2024-11-02T03:15:13+00:00 |
Last Scan
| Scanned | 2024-10-26T03:15:13+00:00 |
| URL | https://lecremedelacrumb.com/robots.txt |
| Domain IPs | 104.21.61.41, 172.67.205.253, 2606:4700:3030::6815:3d29, 2606:4700:3037::ac43:cdfd |
| Response IP | 104.21.61.41 |
| Found | Yes |
| Hash | 35e368f008da565d9b69de39d51a17edc15ceef7b511af068f1eddacd81bf6ae |
| SimHash | 6308d802e193 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /?s=* |
| Disallow | /?ref=* |
| Disallow | /wp-comments-post.php |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.lecremedelacrumb.com/sitemap_index.xml |