bbcgoodfood.com
robots.txt
Robots Exclusion Standard data for bbcgoodfood.com
Resource Scan
Scan Details
| Site Domain | bbcgoodfood.com |
| Base Domain | bbcgoodfood.com |
| Scan Status | Ok |
| Last Scan | 2024-11-09T16:21:02+00:00 |
| Next Scan | 2024-11-16T16:21:02+00:00 |
Last Scan
| Scanned | 2024-11-09T16:21:02+00:00 |
| URL | https://bbcgoodfood.com/robots.txt |
| Redirect | https://www.bbcgoodfood.com/robots.txt |
| Redirect Domain | www.bbcgoodfood.com |
| Redirect Base | bbcgoodfood.com |
| Domain IPs | 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91 |
| Redirect IPs | 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91 |
| Response IP | 199.232.45.91 |
| Found | Yes |
| Hash | aa3745d3e638d7e607b12bf2cfd7a275e5ae424ef107c97b1f8af2e2fa76e1f0 |
| SimHash | 61bb12cb1c33 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /4817/ |
| Disallow | /176986657/ |
| Disallow | /styleguide/ |
| Disallow | /author/mrben/ |
| Disallow | /members/ |
| Disallow | /account/ |
| Disallow | /signin/ |
| Disallow | /account/ |
| Disallow | /auth/ |
| Disallow | /search/recipes/?q= |
| Disallow | /search/recipes/?sort= |
| Disallow | /search/recipes/page/ |
| Disallow | /search/node |
| Disallow | /api/ |
| Disallow | /article/welcome-email |
| Disallow | /article/thank-you-registering |
| Disallow | /article/thank-you-signing-health-edit |
| Disallow | *null? |
| Disallow | *obOrigUrl%3Dtrue |
| Disallow | /seasonal-calendar/all |
| Disallow | /Search?searchstring_input= |
| Disallow | /v1/ |
| Disallow | *wp-sitemap-taxonomies-post_tag |
| Disallow | /user/login |
| Disallow | /search |
| Disallow | /search-results/ |
| Disallow | /user/*/collections/ |
| Disallow | /user/*/collection/ |
| Disallow | /user/register |
| Disallow | /wp-sitemap-posts- |
| Disallow | /list-v2/ |
| Disallow | /article-v2/ |
| Disallow | /search-results/ |
| Disallow | /registration |
| Disallow | /registration/ |
| Disallow | /forgotten-password |
| Disallow | /forgotten-password/ |
| Disallow | /change-password/ |
| Disallow | /reset-password |
| Disallow | /reset-password/ |
| Disallow | /login |
| Disallow | /login/ |
| Disallow | /log-out |
| Disallow | /log-out/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bbcgoodfood.com/membersitemap.xml |
| sitemap | https://www.bbcgoodfood.com/google-news.xml/ |
| sitemap | https://www.bbcgoodfood.com/sitemap.xml |
Comments