x04ydivan.ru
robots.txt

Robots Exclusion Standard data for x04ydivan.ru

Resource Scan

Scan Details

Site Domain x04ydivan.ru
Base Domain x04ydivan.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-09T07:40:40+00:00
Next Scan 2025-12-08T07:40:40+00:00

Last Successful Scan

Scanned2023-04-25T23:20:33+00:00
URL https://x04ydivan.ru/robots.txt
Domain IPs 31.31.196.157
Response IP 31.31.196.157
Found Yes
Hash 5b3370e34a461ca6f2fc678600f6b56b14ba1b756801f560968328bb7ee6af85
SimHash 010597338f67

Groups

*

Rule Path
Allow /
Disallow /admin
Disallow /sravnivaemi_tovari
Disallow /prays_list_na_uslugi_dostavki
Disallow /ne_nashli_nuzhnu_tkan_na_sayte_poishchi_u_nashih_partnerov
Disallow /*tovar_mesyatsa*
Disallow /*novinki*
Disallow /*mebelnie_tkani*
Disallow /*index.php*
Disallow /catalog/kresla/*
Disallow /mebel_so_sklada/0
Disallow /mebel_so_sklada/1
Disallow /mebel_so_sklada/kresla
Disallow /mebel_so_sklada/pufiki
Disallow /goryachee_predlozhenie
Disallow /catalog/divani/0
Disallow /catalog/divani_knizhki/0
Disallow /catalog/divani_krovati/0
Disallow /catalog/divani_krovati/6
Disallow /catalog/uglovie_divani/0
Disallow /catalog/uglovie_divani/1
Disallow /catalog/uglovie_divani/2
Disallow /catalog/nabori_mebeli/0
Disallow /catalog/kresla0/0
Disallow /catalog/kresla0/1
Disallow /catalog/kresla0/2
Disallow /catalog/kresla0/3
Disallow /catalog/kresla_dlya_otdiha/0
Disallow /catalog/kresla_kachalki/0
Disallow /catalog/kresla_krovati/0
Disallow /catalog/kresla_krovati/1
Disallow /catalog/kresla_krovati/2
Disallow /catalog/krovati_i_tahti0/0
Disallow /catalog/dvuhspalnie_krovati/0
Disallow /catalog/krovat_cherdak/0
Disallow /catalog/tahti/0
Disallow /catalog/tahti/1
Disallow /catalog/tahti/2
Disallow /catalog/tahta_uglovaya/0
Disallow /catalog/tahta_krovat/0
Disallow /catalog/pufiki/0
Disallow /catalog/pufiki/1

Warnings

  • `host` is not a known field.