herbiware.com
robots.txt
Robots Exclusion Standard data for herbiware.com
Resource Scan
Scan Details
| Site Domain | herbiware.com |
| Base Domain | herbiware.com |
| Scan Status | Ok |
| Last Scan | 5/26/2025, 4:54:24 PM |
| Next Scan | 6/2/2025, 4:54:24 PM |
Last Scan
| Scanned | 5/26/2025, 4:54:24 PM |
| URL | https://herbiware.com/robots.txt |
| Domain IPs | 104.21.57.239, 172.67.193.222, 2606:4700:3032::ac43:c1de, 2606:4700:3033::6815:39ef |
| Response IP | 104.21.57.239 |
| Found | Yes |
| Hash | dc7f4efde0679b0a904fcbb12aabc451c1937cecd5d77f67ba67c7f3ea9c0552 |
| SimHash | ed154c526b53 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /connect/* |
| Disallow | /uploads/* |
| Disallow | /cart |
| Disallow | /cdn-cgi/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://herbiware.com/sitemap.xml |