nutritist.us
robots.txt
Robots Exclusion Standard data for nutritist.us
Resource Scan
Scan Details
| Site Domain | nutritist.us |
| Base Domain | nutritist.us |
| Scan Status | Ok |
| Last Scan | 2025-11-01T22:54:37+00:00 |
| Next Scan | 2025-11-15T22:54:37+00:00 |
Last Scan
| Scanned | 2025-11-01T22:54:37+00:00 |
| URL | https://nutritist.us/robots.txt |
| Redirect | https://www.nutritist.us/robots.txt |
| Redirect Domain | www.nutritist.us |
| Redirect Base | nutritist.us |
| Domain IPs | 23.227.38.65 |
| Redirect IPs | 23.227.38.74, 2620:127:f00f:e:: |
| Response IP | 23.227.38.74 |
| Found | Yes |
| Hash | 90013156d2a063f76dcc5e211f6247c151047cd41bfc7d3ec91b3ea197d3af5a |
| SimHash | 1eb00b405df2 |
Groups
google-extended
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /cart |
| Disallow | /checkout |
| Disallow | /account |
| Allow | / |
cohere-training-data-crawler
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /cart |
| Disallow | /checkout |
| Disallow | /account |
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /cart |
| Disallow | /orders |
| Disallow | /checkout |
| Disallow | /account |
| Disallow | /collections/*%2B* |
| Disallow | /collections/*%2B* |
| Disallow | /collections/*?*sort_by* |
| Disallow | /collections/*?*page* |
| Disallow | /blogs/*%2B* |
| Disallow | /blogs/*%2B* |
| Disallow | /blogs/*?*sort_by* |
| Disallow | /blogs/*?*page* |
| Disallow | /*?*design_theme_id* |
| Disallow | /*preview_theme_id* |
| Disallow | /*?*variant=* |
| Disallow | /*?*view=* |
| Disallow | /policies/*?*page* |
| Disallow | /search |
| Disallow | /apple-app-site-association |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.nutritist.us/sitemap.xml |
Comments