bodybuilding.com
robots.txt
Robots Exclusion Standard data for bodybuilding.com
Resource Scan
Scan Details
| Site Domain | bodybuilding.com |
| Base Domain | bodybuilding.com |
| Scan Status | Ok |
| Last Scan | 2024-05-03T18:21:19+00:00 |
| Next Scan | 2024-05-10T18:21:19+00:00 |
Last Scan
| Scanned | 2024-05-03T18:21:19+00:00 |
| URL | https://bodybuilding.com/robots.txt |
| Redirect | https://www.bodybuilding.com/robots.txt |
| Redirect Domain | www.bodybuilding.com |
| Redirect Base | bodybuilding.com |
| Domain IPs | 15.197.167.90, 3.33.186.135 |
| Redirect IPs | 13.215.31.72, 175.41.180.202, 2406:da18:b3d:e201::1f4, 2406:da18:b3d:e202::1f4 |
| Response IP | 175.41.180.202 |
| Found | Yes |
| Hash | 07eb6a684e146e4eec1113f7d64726341f5800fca0b29391f9705ac3d606ba06 |
| SimHash | 30250c4d09b0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /billing.jsp |
| Disallow | /cart.jsp |
| Disallow | /change-store.jsp |
| Disallow | /commerce |
| Disallow | /*_DARGS |
| Disallow | /fun/printlog2.php |
| Disallow | /login.jsp |
| Disallow | /printlog2.php |
| Disallow | /mobile |
| Disallow | /product-recommended.jsp |
| Disallow | /shipping.jsp |
| Disallow | /store/account/ |
| Disallow | /store/catalog/category.jsp |
| Disallow | /store/catalog/productcomparison/product-comparison.jsp |
| Disallow | /store/commerce/wheycheap/wheycheap.jsp |
| Disallow | /store/common/ajax/catalog/ingredient-xhr.jsp |
| Disallow | /store/*?ep* |
| Disallow | /wish-list.jsp |
| Disallow | /.pdf* |
| Disallow | /search.php |
| Disallow | /store/ajax/leftnav-*-options.nav |
| Disallow | /store/common/content/ajax/geo-ip-change-store-modal-content.jsp |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bodybuilding.com/sitemap.xml |
Warnings
- `noindex` is not a known field.
Comments