qa.iherb.com
robots.txt
Robots Exclusion Standard data for qa.iherb.com
Resource Scan
Scan Details
| Site Domain | qa.iherb.com |
| Base Domain | iherb.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-08-23T08:43:11+00:00 |
| Next Scan | 2025-11-21T08:43:11+00:00 |
Last Successful Scan
| Scanned | 2025-04-19T07:09:25+00:00 |
| URL | https://qa.iherb.com/robots.txt |
| Domain IPs | 104.18.38.11, 172.64.149.245 |
| Response IP | 104.18.38.11 |
| Found | Yes |
| Hash | 18403953a17782284b3f7fcaf865a0430f84cc7ff8e8a9ef5d0ac6fd5385bb81 |
| SimHash | 02c69b4be999 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /tr/list |
| Allow | /tr/cb |
| Disallow | /tr/ |
| Disallow | /EditCart |
| Disallow | /WishList |
| Disallow | /Logout |
| Disallow | /Checkout |
| Disallow | /ordersummary |
| Disallow | /NotificationList |
| Disallow | /ChangePassword |
| Disallow | /AddressBook |
| Disallow | /Profile |
| Disallow | /PersonalInfo |
| Disallow | /Pro/RecentProductSelection |
| Disallow | /Pro/VisitedProduct |
| Disallow | /Pro/GetFeatured |
| Disallow | /Pro/CustomerBought |
| Disallow | /Pro/EnableCustomerHistory |
| Disallow | /Pro/DisableCustomerHistory |
| Disallow | /Pro/ReviewFeedback |
| Disallow | /Pro/ViewSwitcher |
| Disallow | /Pro/Maintentance |
| Disallow | /Pro/ReportAbuse |
| Disallow | /Pro/CustomerViewed |
| Disallow | /info/rewards |
| Disallow | /info/affiliates-migration |
| Disallow | /Search |
| Disallow | /search |
| Disallow | /home/error/_404 |
| Disallow | /me/* |
| Disallow | /Me/* |
| Disallow | /cart |
| Disallow | /*%40iherb |
| Disallow | /ugc/sharedreview/ |
| Disallow | /ugc/sharedReview/ |
| Disallow | /ugc/wishlist |
| Disallow | /qna/ |
| Disallow | /*discontinued |
| Disallow | /*Discontinued |
| Disallow | /quiz/* |
| Disallow | /Quiz/* |
| Disallow | /c/*/lib/* |
| Disallow | /pr/*/lib/* |
| Disallow | /r/*/lib/* |
| Disallow | /r/*p%3D* |
| Disallow | /autoship-save?*p= |
| Allow | /autoship-save?*p=2 |
| Allow | /autoship-save?*p=3 |
| Allow | /r/*%26p%3D2 |
| Allow | /r/*%26p%3D3 |
| Allow | /r/*%26p%3D2* |
| Allow | /r/*%26p%3D3* |
| Allow | /r/*?p=2* |
| Allow | /r/*?p=3* |
| Disallow | /*?*storeid= |
| Disallow | /*?*lac= |
| Disallow | /*?*ctcpref= |
| Disallow | /*?*fv= |
| Disallow | /*?*ctc= |
| Disallow | /*?*partnerId= |
| Disallow | /*?*crc= |
| Disallow | /*?*ccpref= |
| Disallow | /*?*affiliate_source= |
| Disallow | /*?*clickref= |
| Disallow | /*?*partnerCustomerId= |
| Disallow | /*?*som= |
| Disallow | /*?*lcpref= |
| Disallow | /*?*wpref= |
| Disallow | /*?*subcode= |
| Disallow | /*?*currency= |
| Disallow | /*?*disableHeaderFooter= |
| Disallow | /*?*domain= |
| Disallow | /*?*lang= |
| Disallow | /*?*language= |
| Disallow | /*?*postalCode= |
| Disallow | /*?*requestId= |
| Disallow | /*?*storeid= |
| Disallow | /*?*token= |
| Disallow | /*?*isshowtranslated= |
| Disallow | /*?*revl= |
| Disallow | /*?*v= |
| Disallow | /*?*wpc= |
| Disallow | /*?*weightFilters= |
| Disallow | /*?*tr= |
| Disallow | /*?*sug= |
| Disallow | /*?*sss= |
| Disallow | /*?*sr= |
| Disallow | /*?*specialtyFilters= |
| Disallow | /*?*sit= |
| Disallow | /*?*revl= |
| Disallow | /*?*ratings= |
| Disallow | /*?*ranges= |
| Disallow | /*?*pmin= |
| Disallow | /*?*pmin= |
| Disallow | /*?*noi= |
| Disallow | /*?*htids= |
| Disallow | /*?*fr= |
| Disallow | /*?*dym= |
| Disallow | /*?*disc= |
| Disallow | /*?*cpt= |
| Disallow | /*?*cids= |
| Disallow | /*?*cbt= |
| Disallow | /*?*sort= |
| Disallow | /*?*avids= |
| Disallow | /ugc/api/helpful/status |
| Disallow | /ugc/api/customer/review |
| Disallow | /ugc/api/tag/ |
| Disallow | /ugc/api/review/ |
| Disallow | /ugc/api/answer/ |
| Disallow | /ugc/api/product/*/question/search |
| Disallow | /ugc/api/product/*/review/summarization |
| Disallow | /*/constants$ |
| Disallow | /*/utilities$ |
| Disallow | /*/implicit$ |
| Disallow | /*/http$ |
| Disallow | /*/event-trace$ |
| Disallow | /*/token$ |
| Disallow | /*/trace-minerals-r$ |
| Disallow | /*/user-preference$ |
| Disallow | /*/2132Nature$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.iherb.com/sitemap_index.xml |
Comments