honest-boost.com
robots.txt
Robots Exclusion Standard data for honest-boost.com
Resource Scan
Scan Details
| Site Domain | honest-boost.com |
| Base Domain | honest-boost.com |
| Scan Status | Ok |
| Last Scan | 2025-03-28T21:53:44+00:00 |
| Next Scan | 2025-04-27T21:53:44+00:00 |
Last Scan
| Scanned | 2025-03-28T21:53:44+00:00 |
| URL | https://honest-boost.com/robots.txt |
| Domain IPs | 104.21.46.188, 172.67.141.100, 2606:4700:3037::6815:2ebc, 2606:4700:3037::ac43:8d64 |
| Response IP | 172.67.141.100 |
| Found | Yes |
| Hash | de913dce783b2919e8247f4d97556fa0b2046262b770c113bdd65f13114e3633 |
| SimHash | 4868940253fc |
Groups
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /*.css |
| Allow | /*.js |
| Allow | /*.svg |
| Allow | /*.jpg |
| Allow | /*.jpeg |
| Allow | /*.png |
| Allow | /*.gif |
| Allow | /*.webp |
| Allow | /*.ttf |
| Allow | /*.eot |
| Allow | /*.woff |
| Allow | /*.woff2 |
| Allow | |
| Allow | /*sitemap*.xml |
| Allow | /*sitemap*.xml.gz |
| Disallow | */bin/ |
| Disallow | */cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /*.php$ |
| Disallow | /*.htm*$ |
| Disallow | /*.shtml$ |
| Disallow | /*.txt$ |
| Disallow | /*.log.*$ |
| Disallow | /*.sql$ |
| Disallow | /author/ |
| Disallow | /tag/ |
| Disallow | /category/uncategorized/ |
| Disallow | */blackhole/ |
| Disallow | */feed/ |
| Disallow | */embed/ |
| Disallow | /search/ |
| Disallow | */trackback/ |
| Disallow | /*?* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
yandex
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /*.css |
| Allow | /*.js |
| Allow | /*.svg |
| Allow | /*.jpg |
| Allow | /*.jpeg |
| Allow | /*.png |
| Allow | /*.gif |
| Allow | /*.webp |
| Allow | /*.ttf |
| Allow | /*.eot |
| Allow | /*.woff |
| Allow | /*.woff2 |
| Allow | |
| Allow | /*sitemap*.xml |
| Allow | /*sitemap*.xml.gz |
| Disallow | */bin/ |
| Disallow | */cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /*.php$ |
| Disallow | /*.htm*$ |
| Disallow | /*.shtml$ |
| Disallow | /*.txt$ |
| Disallow | /*.log.*$ |
| Disallow | /*.sql$ |
| Disallow | /author/ |
| Disallow | /tag/ |
| Disallow | /category/uncategorized/ |
| Disallow | */blackhole/ |
| Disallow | */feed/ |
| Disallow | */embed/ |
| Disallow | /search/ |
| Disallow | */trackback/ |
| Disallow | /*?* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
bingbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /*.css |
| Allow | /*.js |
| Allow | /*.svg |
| Allow | /*.jpg |
| Allow | /*.jpeg |
| Allow | /*.png |
| Allow | /*.gif |
| Allow | /*.webp |
| Allow | /*.ttf |
| Allow | /*.eot |
| Allow | /*.woff |
| Allow | /*.woff2 |
| Allow | |
| Allow | /*sitemap*.xml |
| Allow | /*sitemap*.xml.gz |
| Disallow | */bin/ |
| Disallow | */cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /*.php$ |
| Disallow | /*.htm*$ |
| Disallow | /*.shtml$ |
| Disallow | /*.txt$ |
| Disallow | /*.log.*$ |
| Disallow | /*.sql$ |
| Disallow | /author/ |
| Disallow | /tag/ |
| Disallow | /category/uncategorized/ |
| Disallow | */blackhole/ |
| Disallow | */feed/ |
| Disallow | */embed/ |
| Disallow | /search/ |
| Disallow | */trackback/ |
| Disallow | /*?* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /*.css |
| Allow | /*.js |
| Allow | /*.svg |
| Allow | /*.jpg |
| Allow | /*.jpeg |
| Allow | /*.png |
| Allow | /*.gif |
| Allow | /*.webp |
| Allow | /*.ttf |
| Allow | /*.eot |
| Allow | /*.woff |
| Allow | /*.woff2 |
| Allow | |
| Allow | /*sitemap*.xml |
| Allow | /*sitemap*.xml.gz |
| Disallow | */bin/ |
| Disallow | */cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /*.php$ |
| Disallow | /*.htm*$ |
| Disallow | /*.shtml$ |
| Disallow | /*.txt$ |
| Disallow | /*.log.*$ |
| Disallow | /*.sql$ |
| Disallow | /author/ |
| Disallow | /tag/ |
| Disallow | /category/uncategorized/ |
| Disallow | */blackhole/ |
| Disallow | */feed/ |
| Disallow | */embed/ |
| Disallow | /search/ |
| Disallow | */trackback/ |
| Disallow | /*?* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Warnings
- `host` is not a known field.