profiandhobby.ru
robots.txt
Robots Exclusion Standard data for profiandhobby.ru
Resource Scan
Scan Details
| Site Domain | profiandhobby.ru |
| Base Domain | profiandhobby.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-29T00:26:05+00:00 |
| Next Scan | 2024-11-28T00:26:05+00:00 |
Last Scan
| Scanned | 2024-10-29T00:26:05+00:00 |
| URL | https://profiandhobby.ru/robots.txt |
| Domain IPs | 87.249.41.114 |
| Response IP | 87.249.41.114 |
| Found | Yes |
| Hash | 315b436a0ba6dfdd8b6489cfae1d13768d939fb006a93937c78f13f31a3fc2b3 |
| SimHash | 025ec973c791 |
Groups
exabot
idbot
wotbox
baiduspider
baiduspider-image
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-cpro
baiduspider-ads
baidu
mj12bot
ahrefsbot
dotbot
riddler
semrushbot
linkpadbot
blexbot
flipboardproxy
aihitbot
trovitbot
ccbot
xenu link sleuth
bot/
ng 1.x
barkrowler/0.9
bingbot
ia_archiver
seokicks
| Rule | Path |
|---|---|
| Disallow | / |
googlebot
| Rule | Path |
|---|---|
| Disallow | /sravnenie/ |
| Disallow | /*/minka/ |
| Disallow | /*/derevyannye_dveri_p_h_1/ |
| Disallow | /*/zaglushki_ruchki_komissionnyy_tovar_bez_nds/ |
| Disallow | /*/verstaki_sintai/ |
| Disallow | /*/fasady_klassika_khv_kat_ekstra_profi_hobby_20mm/ |
| Disallow | /*/derevyannye_dveri_p_h/dp_rustik_2000_kh_600_a_srashchennyy_1/ |
| Disallow | /*/shchit_el_18_mm_a/ |
| Disallow | /*/fasady_modern_khv_kat_ekstra_profi_hobby_20mm/ |
| Disallow | /*/cherdachnye_lestnitsy_minka/ |
| Disallow | /*/osmo_dlya_vnutrennikh_rabot/ |
| Disallow | /*/derevyannye_dveri_p_h/ |
| Disallow | /*/fasady_klassika_khv_kat_ekstra_profi_hobby_20mm/ |
| Disallow | /bitrix/ |
| Disallow | /auth/ |
| Disallow | /personal/ |
| Disallow | /search/ |
| Disallow | /login/ |
| Disallow | /*/search/ |
| Disallow | /*COURSE_ID%3D |
| Disallow | /*?COURSE_ID= |
| Disallow | /*ID%3D |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*?PAGEN |
| Disallow | /*PAGEN_1%3D |
| Disallow | /*PAGEN_2%3D |
| Disallow | /*PAGEN_3%3D |
| Disallow | /*PAGEN_4%3D |
| Disallow | /*PAGEN_5%3D |
| Disallow | /*PAGEN_6%3D |
| Disallow | /*PAGE_NAME%3Dsearch |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*/slide_show/ |
| Disallow | /*/gallery/*order%3D* |
| Disallow | /*?print= |
| Disallow | /*%26amp%3Bprint%3D |
| Disallow | /*register%3Dyes |
| Disallow | /*forgot_password%3Dyes |
| Disallow | /*change_password%3Dyes |
| Disallow | /*login%3Dyes |
| Disallow | /*logout%3Dyes |
| Disallow | /*auth%3Dyes |
| Disallow | /*action%3DADD_TO_COMPARE_LIST |
| Disallow | /*action%3DDELETE_FROM_COMPARE_LIST |
| Disallow | /*action%3DADD2BASKET |
| Disallow | /*action%3DBUY |
| Disallow | /*print_course%3DY |
| Disallow | /*bitrix_*%3D |
| Disallow | /*backurl%3D* |
| Disallow | /*BACKURL%3D* |
| Disallow | /*back_url_admin%3D* |
| Disallow | /*show_all%3D |
| Disallow | /*? |
| Disallow | /*?action= |
| Disallow | /*back_url%3D* |
| Disallow | /*BACK_URL%3D* |
| Disallow | /*login%3D |
| Disallow | /*logout%3D |
| Disallow | /*SHOWALL |
| Disallow | /*index.php$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://profiandhobby.ru/sitemap.xml |
Warnings
- `host` is not a known field.
Comments