howtogetrid.ru
robots.txt
Robots Exclusion Standard data for howtogetrid.ru
Resource Scan
Scan Details
| Site Domain | howtogetrid.ru |
| Base Domain | howtogetrid.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-24T11:04:58+00:00 |
| Next Scan | 2024-10-01T11:04:58+00:00 |
Last Scan
| Scanned | 2024-09-24T11:04:58+00:00 |
| URL | https://howtogetrid.ru/robots.txt |
| Domain IPs | 45.130.41.29 |
| Response IP | 45.130.41.29 |
| Found | Yes |
| Hash | cc7c0b14dfb9b8fa7493afa36d889e537df9bb65d9a0a6c3a11822c53a23014d |
| SimHash | 091d53c3c8c5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /assets/plugins |
| Disallow | /assets/cache |
| Disallow | /assets/themes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-content/themes |
| Disallow | /trackback |
| Disallow | */trackback |
| Disallow | */*/trackback |
| Disallow | */*/feed/*/ |
| Disallow | */feed |
| Disallow | /*?* |
| Disallow | /tag |
| Disallow | /know |
| Disallow | /author |
| Disallow | /politika-konfidencialnosti/ |
| Disallow | /polzovatelskoe-soglashenie/ |
| Disallow | /category/poleznye-sovety/page/1/ |
| Disallow | /category/poleznye-sovety/page/2/ |
| Disallow | /category/poleznye-sovety/page/3/ |
| Disallow | /category/poleznye-sovety/page/4/ |
| Disallow | /category/poleznye-sovety/page/5/ |
| Disallow | /category/poleznye-sovety/page/6/ |
| Disallow | /category/poleznye-sovety/page/7/ |
| Disallow | /category/poleznye-sovety/page/8/ |
| Disallow | */embed* |
| Disallow | */wp-json* |
yandex
| Rule | Path |
|---|---|
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /assets/plugins |
| Disallow | /assets/cache |
| Disallow | /assets/themes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-content/themes |
| Disallow | /trackback |
| Disallow | */trackback |
| Disallow | */*/trackback |
| Disallow | */*/feed/*/ |
| Disallow | */feed |
| Disallow | /*?* |
| Disallow | /tag |
| Disallow | /know |
| Disallow | /author |
| Disallow | /politika-konfidencialnosti/ |
| Disallow | /polzovatelskoe-soglashenie/ |
| Disallow | /category/poleznye-sovety/page/1/ |
| Disallow | /category/poleznye-sovety/page/2/ |
| Disallow | /category/poleznye-sovety/page/3/ |
| Disallow | /category/poleznye-sovety/page/4/ |
| Disallow | /category/poleznye-sovety/page/5/ |
| Disallow | /category/poleznye-sovety/page/6/ |
| Disallow | /category/poleznye-sovety/page/7/ |
| Disallow | /category/poleznye-sovety/page/8/ |
| Disallow | */embed* |
| Disallow | */wp-json* |
mail.ru
| Rule | Path |
|---|---|
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /assets/plugins |
| Disallow | /assets/cache |
| Disallow | /assets/themes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-content/themes |
| Disallow | /trackback |
| Disallow | */trackback |
| Disallow | */*/trackback |
| Disallow | */*/feed/*/ |
| Disallow | */feed |
| Disallow | /*?* |
| Disallow | /tag |
| Disallow | /know |
| Disallow | /author |
| Disallow | /politika-konfidencialnosti/ |
| Disallow | /polzovatelskoe-soglashenie/ |
| Disallow | /category/poleznye-sovety/page/1/ |
| Disallow | /category/poleznye-sovety/page/2/ |
| Disallow | /category/poleznye-sovety/page/3/ |
| Disallow | /category/poleznye-sovety/page/4/ |
| Disallow | /category/poleznye-sovety/page/5/ |
| Disallow | /category/poleznye-sovety/page/6/ |
| Disallow | /category/poleznye-sovety/page/7/ |
| Disallow | /category/poleznye-sovety/page/8/ |
| Disallow | */embed* |
| Disallow | */wp-json* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://howtogetrid.ru/sitemap.xml.gz |
| sitemap | https://howtogetrid.ru/sitemap.xml |