allensrecipes.com
robots.txt
Robots Exclusion Standard data for allensrecipes.com
Resource Scan
Scan Details
| Site Domain | allensrecipes.com |
| Base Domain | allensrecipes.com |
| Scan Status | Ok |
| Last Scan | 2026-03-18T23:14:32+00:00 |
| Next Scan | 2026-03-25T23:14:32+00:00 |
Last Scan
| Scanned | 2026-03-18T23:14:32+00:00 |
| URL | https://allensrecipes.com/robots.txt |
| Redirect | https://www.allensrecipes.com/robots.txt |
| Redirect Domain | www.allensrecipes.com |
| Redirect Base | allensrecipes.com |
| Domain IPs | 2a02:4780:38:3947:c51e:2f44:3536:851e, 2a02:4780:39:3ba2:4841:b767:dffe:c5f2, 84.32.84.114, 88.222.222.239 |
| Redirect IPs | 2a02:4780:84:5692:dbfe:6349:13cc:ad09, 2a02:4780:85:751c:c7e5:da9d:5ba0:4b0d, 84.32.84.211, 88.222.222.41 |
| Response IP | 91.108.100.250 |
| Found | Yes |
| Hash | ef1b2148d8265da0497c59ada2eb4124395a38c7e582146c2a5262ad8ae3e2fc |
| SimHash | cd204f470bb4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?s= |
| Disallow | /*/?fbclid= |
| Disallow | /search/ |
| Disallow | */feed/ |
| Disallow | */feed |
| Disallow | /wprm_print/ |
| Disallow | /cgi-bin/ |
| Disallow | /xmlrpc.php |
| Disallow | */embed/ |
| Disallow | /trackback/ |
| Disallow | /comments/ |
| Disallow | */tag/ |
| Disallow | */tag |
| Disallow | /wp-login.php |
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.allensrecipes.com/sitemap_index.xml |