chefspencil.com
robots.txt
Robots Exclusion Standard data for chefspencil.com
Resource Scan
Scan Details
| Site Domain | chefspencil.com |
| Base Domain | chefspencil.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T09:13:28+00:00 |
| Next Scan | 2024-09-27T09:13:28+00:00 |
Last Scan
| Scanned | 2024-09-20T09:13:28+00:00 |
| URL | https://chefspencil.com/robots.txt |
| Domain IPs | 35.208.78.165 |
| Response IP | 35.208.78.165 |
| Found | Yes |
| Hash | a018650343ee4ff2889aaeeb2cc33085d586565e8e6c24321a431750e8f4d321 |
| SimHash | 31a9d0054623 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-login.php?redirect_to= |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /post_format-sitemap.xml |
| Disallow | /post_tag-sitemap.xml |
| Disallow | /attachment-sitemap1.xml |
| Disallow | /attachment-sitemap2.xml |
| Disallow | /administrator/calin-onet/ |
| Disallow | /search/ |
| Disallow | /contributor/ |
| Disallow | /page/15/ |
| Disallow | /page/16/ |
| Disallow | /wprm_recipe-sitemap.xml |
| Disallow | /profile/* |
| Disallow | /logout-2/ |
| Disallow | /login/ |
| Disallow | /osetin_review-sitemap.xml |
| Disallow | /chefs/ |
| Disallow | /?s=* |
| Disallow | /?attachment_id |
| Allow | /chefs/clive-fretwell/ |
| Allow | /chefs/fergus-henderson/ |
| Allow | /chefs/chefs-pencil-staff/ |
| Allow | /chefs/thorsten-schmidt/ |
| Allow | /chefs/julie-zawadzki/ |
| Allow | /chefs/shannon-bennett/ |
| Allow | /contributor/paul-hegeman/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.chefspencil.com/sitemap_index.xml |