suplments.com
robots.txt
Robots Exclusion Standard data for suplments.com
Resource Scan
Scan Details
| Site Domain | suplments.com |
| Base Domain | suplments.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-11-07T22:27:59+00:00 |
| Next Scan | 2025-02-05T22:27:59+00:00 |
Last Successful Scan
| Scanned | 2024-04-12T22:15:22+00:00 |
| URL | https://suplments.com/robots.txt |
| Redirect | https://www.suplments.com/robots.txt |
| Redirect Domain | www.suplments.com |
| Redirect Base | suplments.com |
| Domain IPs | 178.60.29.219 |
| Redirect IPs | 178.60.29.219 |
| Response IP | 178.60.29.219 |
| Found | Yes |
| Hash | 5b3e779a4175166354f9e0488a112557319ad936483a2e145bc335b4bf9f72d3 |
| SimHash | fa145552b0ba |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ads.txt |
| Disallow | /checkout/ |
| Disallow | /customer/ |
| Disallow | /customer/account/ |
| Disallow | /customer/account/login/ |
| Disallow | /productalert/ |
| Disallow | /catalogsearch/ |
| Disallow | /search/ |
| Disallow | /review/ |
| Disallow | /catalog/product/view/ |
| Disallow | /*?recommendations= |
| Disallow | /*?id= |
| Disallow | /*?page_id= |
| Disallow | /*?SID= |
| Disallow | /*?cat= |
| Disallow | /*?brand= |
| Disallow | /*?gclid= |
| Disallow | /*?LGWCODE= |
| Disallow | /*?dir= |
| Disallow | /*?___store= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.suplments.com/pub/sitemap/sitemap_index.xml |
Warnings
- 2 invalid lines.
- `user-agent` is not a known field.