arbolit.net
robots.txt
Robots Exclusion Standard data for arbolit.net
Resource Scan
Scan Details
| Site Domain | arbolit.net |
| Base Domain | arbolit.net |
| Scan Status | Ok |
| Last Scan | 2026-03-01T14:18:24+00:00 |
| Next Scan | 2026-03-31T14:18:24+00:00 |
Last Scan
| Scanned | 2026-03-01T14:18:24+00:00 |
| URL | http://arbolit.net/robots.txt |
| Domain IPs | 103.73.65.178 |
| Response IP | 103.73.65.178 |
| Found | Yes |
| Hash | 687790520a5044466b2475ad2cd0d6b950f119273c6d39a9e29f021963c01548 |
| SimHash | 866116d70714 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /assets/modules |
| Disallow | /assets/cache |
| Disallow | /assets/themes |
| Disallow | /wp-trackback |
| Disallow | /wp-feed |
| Disallow | /wp-comments |
| Disallow | */trackback |
| Disallow | */feed |
| Disallow | */comments |
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /assets/modules |
| Disallow | /assets/cache |
| Disallow | /assets/themes |
| Disallow | /wp-trackback |
| Disallow | /wp-feed |
| Disallow | /wp-comments |
| Disallow | */trackback |
| Disallow | */feed |
| Disallow | */comments |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.arbolit.net/sitemap.xml |
Warnings
- `host` is not a known field.