cityreporter.ru
robots.txt
Robots Exclusion Standard data for cityreporter.ru
Resource Scan
Scan Details
| Site Domain | cityreporter.ru |
| Base Domain | cityreporter.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-12T10:45:09+00:00 |
| Next Scan | 2024-11-19T10:45:09+00:00 |
Last Scan
| Scanned | 2024-11-12T10:45:09+00:00 |
| URL | https://cityreporter.ru/robots.txt |
| Domain IPs | 194.58.122.220 |
| Response IP | 194.58.122.220 |
| Found | Yes |
| Hash | 131db4b5a3457ddb5c23a08947a971379222953219c10d4c82d5d1a489d98ec9 |
| SimHash | 43b05382c470 |
Groups
*
| Product | Comment |
|---|---|
| * | общие правила для роботов, кроме Яндекса и Google, т.к. для них правила ниже |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /wp-admin | - |
| Disallow | /wp-includes | - |
| Disallow | /wp-content/plugins | - |
| Disallow | /wp-content/cache | - |
| Disallow | /wp-content/themes | - |
| Disallow | /download | - |
| Disallow | /author/ | - |
| Disallow | /cgi-bin | папка на хостинге |
| Disallow | /? | все параметры запроса на главной |
| Disallow | *?s= | поиск |
| Disallow | *%26s%3D | поиск |
| Disallow | /search/ | поиск |
| Disallow | /users/ | архив авторов |
| Disallow | */trackback | трекбеки, уведомления в комментариях о появлении открытой |
| Disallow | */embed | все встраивания |
| Disallow | /xmlrpc.php | файл WordPress API |
| Disallow | *utm*%3D | ссылки с utm-метками |
| Disallow | *openstat%3D | ссылки с метками openstat |
| Allow | */uploads | открываем папку с файлами uploads |
| Allow | /tag/ | - |
googlebot
| Product | Comment |
|---|---|
| googlebot | правила для Google (комментарии не дублирую) |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /wp-admin | - |
| Disallow | /wp-includes | - |
| Disallow | /wp-content/plugins | - |
| Disallow | /wp-content/cache | - |
| Disallow | /wp-content/themes | - |
| Disallow | /download | - |
| Disallow | /author/ | - |
| Disallow | /cgi-bin | - |
| Disallow | /? | - |
| Disallow | *?s= | - |
| Disallow | *%26s%3D | - |
| Disallow | /search/ | - |
| Disallow | /users/ | - |
| Disallow | */trackback | - |
| Disallow | */embed | - |
| Disallow | /xmlrpc.php | - |
| Disallow | *utm*%3D | - |
| Disallow | *openstat%3D | - |
| Allow | /*/*.js | открываем js-скрипты внутри /wp- (/*/ - для приоритета) |
| Allow | /*/*.css | открываем css-файлы внутри /wp- (/*/ - для приоритета) |
| Allow | /wp-*.png | картинки в плагинах, cache папке и т.д. |
| Allow | /wp-*.jpg | картинки в плагинах, cache папке и т.д. |
| Allow | /wp-*.jpeg | картинки в плагинах, cache папке и т.д. |
| Allow | /wp-*.gif | картинки в плагинах, cache папке и т.д. |
| Allow | /wp-admin/admin-ajax.php | используется плагинами, чтобы не блокировать JS и CSS |
| Allow | /category/featured/feed/ | - |
| Allow | /tag/ | - |
yandex
| Product | Comment |
|---|---|
| yandex | правила для Яндекса (комментарии не дублирую) |
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-content/themes |
| Disallow | /download |
| Disallow | /author/ |
| Disallow | /cgi-bin |
| Disallow | /? |
| Disallow | *?s= |
| Disallow | *%26s%3D |
| Disallow | /search/ |
| Disallow | /users/ |
| Disallow | */trackback |
| Disallow | */embed |
| Disallow | /xmlrpc.php |
| Disallow | /chto-uchityvat-pri-pokupke-pechi-dlya-doma/ |
| Disallow | /materialy-dlya-naruzhnoj-otdelki-doma/ |
| Disallow | /chto-delat-pri-pishhevom-otravlenii/ |
| Disallow | /kriterii-pri-vybore-i-pokupke-pnevmogajkoverta/ |
| Disallow | /blyuda-dlya-zdorovogo-zavtraka/ |
| Disallow | /smm-osobennosti-i-preimushhestva-marketinga-v-sotssetyah/ |
| Disallow | /kak-vybrat-metallicheskie-zagrazhdeniya-sovety-i-rekomendatsii/ |
| Disallow | /kak-fizicheskomu-litsu-sdelat-priem-platezhej-na-sajte/ |
| Disallow | /fizicheskoe-i-yuridicheskoe-litso-otlichiya/ |
| Disallow | /stroitelstvo-domov-po-tehnologii-smk/ |
| Disallow | /finansovaya-kultura-komu-i-zachem-ona-nuzhna/ |
| Disallow | /kompaniya-etazhi-tomsk/ |
| Disallow | /promyshlennye-kolesnye-opory/ |
| Disallow | /panoramnye-okna-bezgranichnaya-perspektiva/ |
| Disallow | /peredovye-tehnologii-v-proizvodstve-plastikovyh-okon/ |
| Disallow | /stroitelnye-podemniki-vidy-sfera-primeneniya/ |
| Disallow | /roskosh-i-udobstvo-interernye-kresla-dlya-sozdaniya-elegantnoj-atmosfery/ |
| Disallow | /chto-takoe-dom-biznes-klassa/ |
| Disallow | /shtabeler-dlya-sklada/ |
| Disallow | /arenda-virtualnogo-servera-vps-vse-chto-vam-nuzhno-znat/ |
| Disallow | /kak-podobrat-bankovskuyu-kartu-rebenku/ |
| Disallow | /vygodnye-zajmy/ |
| Disallow | /nepromokaemye-tenty/ |
| Disallow | /aktsiya-skidki-do-20-na-tovary-brenda-cersanit-v-magazine-santehnika-onlajn/ |
| Disallow | /kachestvennyj-uteplitel-dlya-pola-v-vashem-dome/ |
| Disallow | /kachestvennaya-vagonka-iz-listvennitsy-dlya-vashego-doma/ |
| Disallow | /plenka-polietilenovaya/ |
| Disallow | /kak-vybrat-kursy-po-programmirovaniyu-na-java/ |
| Disallow | /profnastil-osobennosti-i-sfera-primeneniya/ |
| Disallow | /materialy-dlya-fasada/ |
| Disallow | /podarki-iz-serebra-zazhim-dlya-deneg/ |
| Disallow | /raznovidnosti-napolnyh-pokrytij/ |
| Disallow | /telezhki-dvuhkolesnye-pravila-vybora/ |
| Disallow | /umnyj-servis-logistiki-povysit-pribylnost-transportnyh-kompanij/ |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | */wp-sitemap |
| Allow | */uploads |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | /wp-*.gif |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /feed/turbo/ |
| Allow | /feed/zen/ |
| Allow | /category/featured/feed/ |
| Allow | /tag/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://cityreporter.ru/sitemap_index.xml |
| sitemap | https://cityreporter.ru/sitemap_index.xml.gz |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments