rustih.ru
robots.txt
Robots Exclusion Standard data for rustih.ru
Resource Scan
Scan Details
| Site Domain | rustih.ru |
| Base Domain | rustih.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-29T07:16:23+00:00 |
| Next Scan | 2024-07-06T07:16:23+00:00 |
Last Scan
| Scanned | 2024-06-29T07:16:23+00:00 |
| URL | https://rustih.ru/robots.txt |
| Domain IPs | 65.108.131.58 |
| Response IP | 65.108.131.58 |
| Found | Yes |
| Hash | 144eed824838add088fbcedb96533aa12952284eefff9e08e00da5cb0163421c |
| SimHash | 6408c0c187a5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-content/plugins |
| Allow | /wp-content/plugins*.css |
| Allow | /wp-content/plugins*.js |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.gif |
| Allow | /*.png |
| Disallow | /js/ |
| Disallow | /trackback |
| Disallow | */trackback |
| Disallow | */*/trackback |
| Disallow | */*/feed/*/ |
| Disallow | */feed |
| Disallow | /tag/ |
| Disallow | /%26 |
| Disallow | /search/ |
| Disallow | /rating_over* |
yandex
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-content/plugins |
| Allow | /wp-content/plugins*.css |
| Allow | /wp-content/plugins*.js |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.gif |
| Allow | /*.png |
| Disallow | /js/ |
| Disallow | */amp/ |
| Disallow | /trackback |
| Disallow | */trackback |
| Disallow | */*/trackback |
| Disallow | */*/feed/*/ |
| Disallow | */feed |
| Disallow | /tag/ |
| Disallow | /%26 |
| Disallow | /search/ |
| Disallow | /rating_over* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rustih.ru/sitemap_index.xml |
Warnings
- `host` is not a known field.