allrecipes.com.mx
robots.txt
Robots Exclusion Standard data for allrecipes.com.mx
Resource Scan
Scan Details
| Site Domain | allrecipes.com.mx |
| Base Domain | allrecipes.com.mx |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-04-06T18:48:33+00:00 |
| Next Scan | 2024-07-05T18:48:33+00:00 |
Last Successful Scan
| Scanned | 2023-12-09T12:01:57+00:00 |
| URL | https://allrecipes.com.mx/robots.txt |
| Domain IPs | 108.139.10.13, 108.139.10.39, 108.139.10.65, 108.139.10.77 |
| Response IP | 18.155.129.10 |
| Found | Yes |
| Hash | edcfa4f231f47a35c7b3c9f9391d45e7f2b13f64b548644de659e4b2d31294d6 |
| SimHash | c714ea92a8d9 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /wp-admin/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
| Disallow | /activate/ | har har |
| Disallow | /cgi-bin/ | MT refugees |
| Disallow | /mshots/v1/ | - |
| Disallow | /public.api/ | - |
| Disallow | /wp-login.php | - |
| Disallow | /*.jhtml | - |
| Disallow | /*___itemUrl___ | - |
| Disallow | /embed | - |
| Disallow | /oembed | - |
| Disallow | /dyn/ | - |
| Disallow | /labs/ | - |
| Disallow | /order/ | - |
| Disallow | /child/ | - |
| Disallow | /photos/ | - |
| Disallow | /common/ | - |
| Disallow | /content/ | - |
| Disallow | /private/ | - |
| Disallow | /premium/ | - |
| Disallow | /partner/ | - |
| Disallow | /templates/ | - |
| Disallow | /community/kudos/ | - |
| Disallow | /community/user/ | - |
| Disallow | /templatedata/ | - |
| Disallow | /videos/theme/ | - |
| Disallow | /videos/widgets/ | - |
| Disallow | /go? | - |
| Disallow | /?s=* | - |
| Disallow | /search* | - |
| Disallow | /next/ | - |
| Disallow | /account | - |
| Disallow | /sweepstakes/rules/ | - |
| Disallow | /sweepstakes/facts/ | - |
irlbot
| Rule | Path | Comment |
|---|---|---|
| Disallow | /wp-admin/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
| Disallow | /activate/ | har har |
| Disallow | /cgi-bin/ | MT refugees |
| Disallow | /mshots/v1/ | - |
| Disallow | /public.api/ | - |
| Disallow | /wp-login.php | - |
| Disallow | /*.jhtml | - |
| Disallow | /*___itemUrl___ | - |
| Disallow | /embed | - |
| Disallow | /oembed | - |
| Disallow | /dyn/ | - |
| Disallow | /labs/ | - |
| Disallow | /order/ | - |
| Disallow | /child/ | - |
| Disallow | /photos/ | - |
| Disallow | /common/ | - |
| Disallow | /content/ | - |
| Disallow | /private/ | - |
| Disallow | /premium/ | - |
| Disallow | /partner/ | - |
| Disallow | /templates/ | - |
| Disallow | /community/kudos/ | - |
| Disallow | /community/user/ | - |
| Disallow | /templatedata/ | - |
| Disallow | /videos/theme/ | - |
| Disallow | /videos/widgets/ | - |
| Disallow | /go? | - |
| Disallow | /?s=* | - |
| Disallow | /search* | - |
| Disallow | /next/ | - |
| Disallow | /account | - |
| Disallow | /sweepstakes/rules/ | - |
| Disallow | /sweepstakes/facts/ | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3600 |
googlebot
| Rule | Path | Comment |
|---|---|---|
| Disallow | /wp-admin/ | - |
| Allow | /wp-admin/admin-ajax.php | - |
| Disallow | /activate/ | har har |
| Disallow | /cgi-bin/ | MT refugees |
| Disallow | /mshots/v1/ | - |
| Disallow | /public.api/ | - |
| Disallow | /wp-login.php | - |
| Disallow | /*.jhtml | - |
| Disallow | /*___itemUrl___ | - |
| Disallow | /embed | - |
| Disallow | /oembed | - |
| Disallow | /dyn/ | - |
| Disallow | /labs/ | - |
| Disallow | /order/ | - |
| Disallow | /child/ | - |
| Disallow | /photos/ | - |
| Disallow | /common/ | - |
| Disallow | /content/ | - |
| Disallow | /private/ | - |
| Disallow | /premium/ | - |
| Disallow | /partner/ | - |
| Disallow | /templates/ | - |
| Disallow | /community/kudos/ | - |
| Disallow | /community/user/ | - |
| Disallow | /templatedata/ | - |
| Disallow | /videos/theme/ | - |
| Disallow | /videos/widgets/ | - |
| Disallow | /go? | - |
| Disallow | /?s=* | - |
| Disallow | /search* | - |
| Disallow | /next/ | - |
| Disallow | /syndication/ | - |
| Disallow | /account | - |
| Disallow | /sweepstakes/rules/ | - |
| Disallow | /sweepstakes/facts/ | - |
| Disallow | /shop/ | - |
| Disallow | /element-api/ | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://peopleenespanol.com/news-sitemap.xml |
| sitemap | https://peopleenespanol.com/sitemap.xml |
Comments