credit-center.ru
robots.txt

Robots Exclusion Standard data for credit-center.ru

Resource Scan

Scan Details

Site Domain credit-center.ru
Base Domain credit-center.ru
Scan Status Ok
Last Scan2024-10-05T16:47:12+00:00
Next Scan 2024-11-04T16:47:12+00:00

Last Scan

Scanned2024-10-05T16:47:12+00:00
URL https://credit-center.ru/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:7:a790, 2a00:15f8:a000:5:1:12:7:a790, 2a00:15f8:a000:5:1:13:7:a790, 2a00:15f8:a000:5:1:14:7:a790, 90.156.201.41, 90.156.201.46, 90.156.201.47, 90.156.201.98
Response IP 90.156.201.46
Found Yes
Hash 2e8495eacba8b431a5559dbad6ce6634b9f48ca8b40d81674f67f012756a5742
SimHash 080498c1eef6

Groups

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yahoo slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandexbot

Rule Path
Disallow /admin
Disallow /lib
Disallow /modules
Disallow /sdannye-novostroyki/kupit-odnokomnatnuyu-kvartiru-v-zhukovskom-v-novostrojke/
Disallow /sdannye-novostroyki/kupit-dvuhkomnatnuyu-kvartiru-v-zhukovskom-v-novostrojke/
Disallow /sdannye-novostroyki/kupit-trehkomnatnuyu-kvartiru-v-zhukovskom-v-novostrojke/
Disallow /sdannye-novostroyki/kupit-chetyrehkomnatnuyu-kvartiru-v-zhukovskom-v-novostrojke/
Disallow /sdannye-novostroyki/kupit-chetyrehkomnatnuyu-kvartiru-v-ramenskom-i-ramenskom-rajone-v-novostrojke/
Disallow /zemelnyye-uchastki-v-ramenskom/6-4112/
Disallow /zemelnyye-uchastki-v-ramenskom/6-4104/
Disallow /arenda-kvartiry-doma-v-ramenskom-zhukovskom/15-299/
Disallow /zemelnyye-uchastki-v-ramenskom/6-4113/
Disallow /zemelnyye-uchastki-v-ramenskom/6-3844/
Disallow /shablony-blokov/
Disallow /search/
Disallow /zayavki-otpravleny/
Disallow /favorites/
Disallow /open/
Disallow /raskrytie-novosti/
Disallow /raskrytie-novosti-spec/
Disallow /raskrytie-novosti-oform/
Disallow /sluzhebnye-stranitsy/
Disallow /table/
Disallow /object/
Disallow /table_print/
Disallow /set_dir/
Disallow /weekly_email/
Disallow /test/
Disallow /subscribe_settings/
Disallow /obekt-pdf/
Disallow /gallery/
Disallow /statistika-po-obektam/
Disallow /promo-2022/
Disallow *print*
Disallow *Banners*
Disallow *print*
Disallow /vdv
Disallow /top10
Disallow /dlya-rieltorov
Disallow /raskrytie-agenta
Disallow /map
Disallow /favorites
Disallow /zayavki-otpravleny
Disallow /sluzhebnye-stranitsy
Allow /

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /admin
Disallow /lib
Disallow /modules
Disallow /sdannye-novostroyki/kupit-odnokomnatnuyu-kvartiru-v-zhukovskom-v-novostrojke/
Disallow /sdannye-novostroyki/kupit-dvuhkomnatnuyu-kvartiru-v-zhukovskom-v-novostrojke/
Disallow /sdannye-novostroyki/kupit-trehkomnatnuyu-kvartiru-v-zhukovskom-v-novostrojke/
Disallow /sdannye-novostroyki/kupit-chetyrehkomnatnuyu-kvartiru-v-zhukovskom-v-novostrojke/
Disallow /sdannye-novostroyki/kupit-chetyrehkomnatnuyu-kvartiru-v-ramenskom-i-ramenskom-rajone-v-novostrojke/
Disallow /zemelnyye-uchastki-v-ramenskom/6-4112/
Disallow /zemelnyye-uchastki-v-ramenskom/6-4104/
Disallow /arenda-kvartiry-doma-v-ramenskom-zhukovskom/15-299/
Disallow /zemelnyye-uchastki-v-ramenskom/6-4113/
Disallow /zemelnyye-uchastki-v-ramenskom/6-3844/
Disallow /shablony-blokov/
Disallow /search/
Disallow /zayavki-otpravleny/
Disallow /favorites/
Disallow /open/
Disallow /raskrytie-novosti/
Disallow /raskrytie-novosti-spec/
Disallow /raskrytie-novosti-oform/
Disallow /sluzhebnye-stranitsy/
Disallow /table/
Disallow /object/
Disallow /table_print/
Disallow /set_dir/
Disallow /weekly_email/
Disallow /test/
Disallow /subscribe_settings/
Disallow /obekt-pdf/
Disallow /gallery/
Disallow /statistika-po-obektam/
Disallow /promo-2022/
Disallow *print*
Disallow *Banners*
Disallow *print*
Disallow /vdv
Disallow /top10
Disallow /dlya-rieltorov
Disallow /raskrytie-agenta
Disallow /map
Disallow /favorites
Disallow /zayavki-otpravleny
Disallow /sluzhebnye-stranitsy
Allow /

Other Records

Field Value
sitemap https://credit-center.ru/sitemap.xml

Comments

  • robots.txt for www.credit-center.ru

Warnings

  • `host` is not a known field.