herbaltricks.com
robots.txt
Robots Exclusion Standard data for herbaltricks.com
Resource Scan
Scan Details
| Site Domain | herbaltricks.com |
| Base Domain | herbaltricks.com |
| Scan Status | Ok |
| Last Scan | 2026-01-08T10:36:17+00:00 |
| Next Scan | 2026-02-07T10:36:17+00:00 |
Last Scan
| Scanned | 2026-01-08T10:36:17+00:00 |
| URL | https://www.herbaltricks.com/robots.txt |
| Domain IPs | 104.21.47.21, 172.67.170.13, 2606:4700:3031::6815:2f15, 2606:4700:3035::ac43:aa0d |
| Response IP | 172.67.170.13 |
| Found | Yes |
| Hash | 98978fa4c0c194e7fd52ddf6a4990bf5315c80bcca0b8dab79023ef06567d238 |
| SimHash | 037e9749f7de |
Groups
*
| Rule | Path |
|---|---|
| Allow | /core/*.css |
| Allow | /core/*.js |
| Allow | /core/*.png |
| Allow | /core/*.jpg |
| Allow | /core/*.jpeg |
| Allow | /core/*.gif |
| Allow | /modules/*.css |
| Allow | /modules/*.js |
| Allow | /modules/*.png |
| Allow | /modules/*.jpg |
| Allow | /modules/*.jpeg |
| Allow | /modules/*.gif |
| Allow | /themes/*.css |
| Allow | /themes/*.js |
| Allow | /themes/*.png |
| Allow | /themes/*.jpg |
| Allow | /themes/*.jpeg |
| Allow | /themes/*.gif |
| Disallow | /admin/ |
| Disallow | /user/ |
| Disallow | /node/add/ |
| Disallow | /node/preview/ |
| Disallow | /comment/reply/ |
| Disallow | /search/ |
| Disallow | /filter/tips/ |
| Disallow | /scripts/ |
| Disallow | /includes/ |
| Disallow | /profiles/ |
| Disallow | /update.php |
| Disallow | /install.php |
| Disallow | /xmlrpc.php |
| Disallow | /*.txt$ |
| Disallow | /CHANGELOG.txt |
| Disallow | /LICENSE.txt |
| Disallow | /UPGRADE.txt |
| Disallow | /INSTALL* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Comments