hardhub.ru
robots.txt
Robots Exclusion Standard data for hardhub.ru
Resource Scan
Scan Details
| Site Domain | hardhub.ru |
| Base Domain | hardhub.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-23T03:57:41+00:00 |
| Next Scan | 2024-11-21T03:57:41+00:00 |
Last Successful Scan
| Scanned | 2024-01-27T02:22:30+00:00 |
| URL | https://hardhub.ru/robots.txt |
| Domain IPs | 91.226.80.112 |
| Response IP | 91.226.80.112 |
| Found | Yes |
| Hash | 51a0cf4d089fd884850d51d28bb8c8573c3a33eb52026a2a12f3063b7ba3a53f |
| SimHash | f5b5a7936c3d |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /app-ads.txt |
| Disallow | /ads.txt |
| Disallow | /logout |
| Disallow | /login |
| Disallow | /closed/ |
| Disallow | /search/ |
| Disallow | /bls/ |
| Disallow | /bps/ |
| Disallow | /product-expand/ |
| Disallow | /register/ |
| Disallow | /favorites/ |
| Disallow | /profile/ |
| Disallow | /comparison/ |
| Disallow | /naznachenie-tovarov/ |
| Disallow | /zakupki/ |
| Disallow | /order/ |
| Disallow | /state/ |
| Disallow | /hit/ |
| Disallow | /card-chart/ |
| Disallow | /card/ |
| Disallow | /partners/map/get-data/ |
| Disallow | /faq/ |
| Disallow | /rezultat/ |
| Disallow | /uslugi/ |
| Disallow | /p1y/ |
| Disallow | /long-chart/ |
| Disallow | /catalog/balka/razmer-is-*/ |
| Disallow | /catalog/shveller/razmer-is-*/ |
| Disallow | /catalog/shveller-gnutiy/razmer-2-is-*/ |
| Disallow | /catalog/list/prokat-is-*/ |
| Disallow | /catalog/kvadrat/razmer-is-*/ |
| Disallow | /catalog/shestigrannik/razmer-is-*/ |
| Disallow | /catalog/provoloka/klass-is-vr-*/ |
| Disallow | /catalog/list-rulon/pokrytie-is-*/ |
| Disallow | /catalog/balka-1/ |
| Disallow | */diametr-is-*/ |
| Disallow | */palitra-is-*/ |
| Disallow | */seller-is-*/ |
| Disallow | */razmer-1-is-*/ |
| Disallow | */razmer-2-is-*/ |
| Disallow | */stal-is-nerzh/ |
| Disallow | */material-is-*/ |
| Disallow | */razmer-is-*/ |
| Disallow | */prokat-is-*/ |
| Disallow | */?diametr |
| Disallow | */?klass |
| Disallow | */?marka |
| Disallow | */?razmer |
| Disallow | */?tip |
| Disallow | */?tolschina |
| Disallow | */?stal |
| Disallow | */?pokrytie |
| Disallow | */?prokat |
| Disallow | */?shirina |
| Disallow | */?price |
| Disallow | */?tsvet |
| Disallow | */?palitra |
| Disallow | */?type |
| Disallow | *page%3D* |
| Disallow | *sort%3D* |
| Disallow | *utm%3D* |
| Disallow | *show%3D* |
| Disallow | *?_gl=* |
| Disallow | *gclid%3D* |
| Disallow | *yclid%3D* |
| Disallow | *etext%3D* |
| Disallow | *yadclid%3D* |
| Disallow | *hash%3D* |
| Disallow | /product/*/1* |
| Disallow | /product/*/2* |
| Disallow | /product/*/3* |
| Disallow | /product/*/4* |
| Disallow | /product/*/5* |
| Disallow | /product/*/6* |
| Disallow | /product/*/7* |
| Disallow | /product/*/8* |
| Disallow | /product/*/9* |
| Disallow | /catalog/metalloprokat/armatura/ar* |
| Disallow | /catalog/metalloprokat/krug/kr* |
| Disallow | /catalog/metalloprokat/list/li* |
| Disallow | /catalog/metalloprokat/balka/ba* |
| Disallow | /catalog/metalloprokat/polosa/po* |
| Disallow | /catalog/metalloprokat/ugolok/ug* |
| Disallow | /catalog/metalloprokat/shveller/sh* |
| Disallow | /catalog/metalloprokat/kvadrat/kv* |
| Disallow | /catalog/metalloprokat/truba-vgp/tr* |
| Disallow | /catalog/metalloprokat/truba-ots/tr* |
| Disallow | /catalog/metalloprokat/truba-e-s/tr* |
| Disallow | /catalog/metalloprokat/provoloka/pr* |
| Disallow | /catalog/metalloprokat/list-rulon/li* |
| Disallow | /catalog/metalloprokat/ugolok-nlg/ug* |
| Disallow | /catalog/metalloprokat/truba-b-sh/tr* |
| Disallow | /catalog/metalloprokat/truba-kh-d/tr* |
| Disallow | /catalog/metalloprokat/truba-n-zh/tr* |
| Disallow | /catalog/metalloprokat/shveller-gnutiy/sh* |
| Disallow | /catalog/metalloprokat/truba-profilnaya/tr* |
| Disallow | /catalog/metalloprokat/setka-armaturnaya/se* |
| Disallow | /catalog/metalloprokat/setka-rabitsa/se* |
| Disallow | /catalog/metalloprokat/setka-tkanaya/se* |
| Allow | /catalog/metalloprokat/armatura/armatura-10/$ |
| Allow | /catalog/metalloprokat/armatura/armatura-10/armatura-10-a500s/$ |
| Allow | /catalog/metalloprokat/armatura/armatura-12/$ |
| Allow | /catalog/metalloprokat/shveller/shveller-18/shveller-18u/$ |
| Allow | /catalog/metalloprokat/list/list-g-k/$ |
| Allow | /catalog/metalloprokat/list/list-kh-k/$ |
| Allow | /catalog/metalloprokat/list/list-ots/$ |
| Allow | /catalog/metalloprokat/shveller/shveller-18/shveller-18u/$ |
| Allow | /catalog/metalloprokat/truba-profilnaya/truba-profilnaya-20-x-20/$ |
| Allow | /catalog/metalloprokat/truba-profilnaya/truba-profilnaya-20-x-20/truba-profilnaya-20-x-20-kh-2-mm/$ |
| Allow | /catalog/metalloprokat/truba-profilnaya/truba-profilnaya-40-x-20/truba-profilnaya-40-x-20-kh-2-mm/$ |
| Allow | /catalog/metalloprokat/truba-profilnaya/truba-profilnaya-40-x-40/$ |
| Allow | /catalog/metalloprokat/truba-profilnaya/truba-profilnaya-40-x-40/truba-profilnaya-40-x-40-kh-2-mm/$ |
| Allow | /articles/?page=* |
| Allow | /news/?page=* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /app-ads.txt |
| Disallow | /ads.txt |
| Disallow | /logout |
| Disallow | /login |
| Disallow | /closed/ |
| Disallow | /search/ |
| Disallow | /bls/ |
| Disallow | /bps/ |
| Disallow | /product-expand/ |
| Disallow | /register/ |
| Disallow | /favorites/ |
| Disallow | /profile/ |
| Disallow | /comparison/ |
| Disallow | /naznachenie-tovarov/ |
| Disallow | /zakupki/ |
| Disallow | /order/ |
| Disallow | /state/ |
| Disallow | /hit/ |
| Disallow | /card-chart/ |
| Disallow | /card/ |
| Disallow | /partners/map/get-data/ |
| Disallow | /faq/ |
| Disallow | /rezultat/ |
| Disallow | /uslugi/ |
| Disallow | /p1y/ |
| Disallow | /long-chart/ |
| Disallow | /catalog/balka/razmer-is-*/ |
| Disallow | /catalog/shveller/razmer-is-*/ |
| Disallow | /catalog/shveller-gnutiy/razmer-2-is-*/ |
| Disallow | /catalog/list/prokat-is-*/ |
| Disallow | /catalog/kvadrat/razmer-is-*/ |
| Disallow | /catalog/shestigrannik/razmer-is-*/ |
| Disallow | /catalog/provoloka/klass-is-vr-*/ |
| Disallow | /catalog/list-rulon/pokrytie-is-*/ |
| Disallow | /catalog/balka-1/ |
| Disallow | */diametr-is-*/ |
| Disallow | */palitra-is-*/ |
| Disallow | */seller-is-*/ |
| Disallow | */razmer-1-is-*/ |
| Disallow | */razmer-2-is-*/ |
| Disallow | */stal-is-nerzh/ |
| Disallow | */material-is-*/ |
| Disallow | */razmer-is-*/ |
| Disallow | */prokat-is-*/ |
| Disallow | */?diametr |
| Disallow | */?klass |
| Disallow | */?marka |
| Disallow | */?razmer |
| Disallow | */?tip |
| Disallow | */?tolschina |
| Disallow | */?stal |
| Disallow | */?pokrytie |
| Disallow | */?prokat |
| Disallow | */?shirina |
| Disallow | */?price |
| Disallow | */?tsvet |
| Disallow | */?palitra |
| Disallow | */?type |
| Disallow | *page%3D* |
| Disallow | *sort%3D* |
| Disallow | *utm%3D* |
| Disallow | *show%3D* |
| Disallow | *?_gl=* |
| Disallow | *gclid%3D* |
| Disallow | *yclid%3D* |
| Disallow | *etext%3D* |
| Disallow | *yadclid%3D* |
| Disallow | *hash%3D* |
| Disallow | /product/*/1* |
| Disallow | /product/*/2* |
| Disallow | /product/*/3* |
| Disallow | /product/*/4* |
| Disallow | /product/*/5* |
| Disallow | /product/*/6* |
| Disallow | /product/*/7* |
| Disallow | /product/*/8* |
| Disallow | /product/*/9* |
| Disallow | /catalog/metalloprokat/armatura/ar* |
| Disallow | /catalog/metalloprokat/krug/kr* |
| Disallow | /catalog/metalloprokat/list/li* |
| Disallow | /catalog/metalloprokat/balka/ba* |
| Disallow | /catalog/metalloprokat/polosa/po* |
| Disallow | /catalog/metalloprokat/ugolok/ug* |
| Disallow | /catalog/metalloprokat/shveller/sh* |
| Disallow | /catalog/metalloprokat/kvadrat/kv* |
| Disallow | /catalog/metalloprokat/truba-vgp/tr* |
| Disallow | /catalog/metalloprokat/truba-ots/tr* |
| Disallow | /catalog/metalloprokat/truba-e-s/tr* |
| Disallow | /catalog/metalloprokat/provoloka/pr* |
| Disallow | /catalog/metalloprokat/list-rulon/li* |
| Disallow | /catalog/metalloprokat/ugolok-nlg/ug* |
| Disallow | /catalog/metalloprokat/truba-b-sh/tr* |
| Disallow | /catalog/metalloprokat/truba-kh-d/tr* |
| Disallow | /catalog/metalloprokat/truba-n-zh/tr* |
| Disallow | /catalog/metalloprokat/shveller-gnutiy/sh* |
| Disallow | /catalog/metalloprokat/truba-profilnaya/tr* |
| Disallow | /catalog/metalloprokat/setka-armaturnaya/se* |
| Disallow | /catalog/metalloprokat/setka-rabitsa/se* |
| Disallow | /catalog/metalloprokat/setka-tkanaya/se* |
| Allow | /catalog/metalloprokat/armatura/armatura-10/$ |
| Allow | /catalog/metalloprokat/armatura/armatura-10/armatura-10-a500s/$ |
| Allow | /catalog/metalloprokat/armatura/armatura-12/$ |
| Allow | /catalog/metalloprokat/shveller/shveller-18/shveller-18u/$ |
| Allow | /catalog/metalloprokat/list/list-g-k/$ |
| Allow | /catalog/metalloprokat/list/list-kh-k/$ |
| Allow | /catalog/metalloprokat/list/list-ots/$ |
| Allow | /catalog/metalloprokat/shveller/shveller-18/shveller-18u/$ |
| Allow | /catalog/metalloprokat/truba-profilnaya/truba-profilnaya-20-x-20/$ |
| Allow | /catalog/metalloprokat/truba-profilnaya/truba-profilnaya-20-x-20/truba-profilnaya-20-x-20-kh-2-mm/$ |
| Allow | /catalog/metalloprokat/truba-profilnaya/truba-profilnaya-40-x-20/truba-profilnaya-40-x-20-kh-2-mm/$ |
| Allow | /catalog/metalloprokat/truba-profilnaya/truba-profilnaya-40-x-40/$ |
| Allow | /catalog/metalloprokat/truba-profilnaya/truba-profilnaya-40-x-40/truba-profilnaya-40-x-40-kh-2-mm/$ |
| Allow | /articles/?page=* |
| Allow | /news/?page=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://hardhub.ru/sitemap.xml |