4f.ua
robots.txt

Robots Exclusion Standard data for 4f.ua

Resource Scan

Scan Details

Site Domain 4f.ua
Base Domain 4f.ua
Scan Status Ok
Last Scan2024-05-31T14:07:59+00:00
Next Scan 2024-06-14T14:07:59+00:00

Last Scan

Scanned2024-05-31T14:07:59+00:00
URL https://4f.ua/robots.txt
Response IP 23.59.168.176
Found Yes
Hash a9fad1147188765dffd4ad7ddfae450a12078948f882139dfa43f7e1bb40fea8
SimHash a85d7881aadd

Groups

*

Rule Path
Disallow /customer/*
Disallow /*reglament*
Disallow /polityka*
Disallow /politika*
Disallow /deklaracii-vidpovidnosti
Disallow /wishlist/
Disallow /admin/
Disallow /checkout*
Disallow /home
Disallow /index.php
Disallow /catalog/category/*
Disallow */catalogsearch*
Disallow */tip_produktu-*-*.html
Disallow */harakteristiki_vzutta-*-*.html
Disallow */cina-*-*.html
Disallow */kolori-*-*.html
Disallow */rozmir-*-*.html
Disallow */krij-*-*.html
Disallow */disciplina-*.html
Disallow */vlastivosti-*.html
Disallow */vodoneproniknist*.html
Disallow */povitroproniknist*.html
Disallow */stat-*-*.html
Disallow */visota_verhnoi_castini-*.html
Disallow */kapuson-*.html
Disallow */utepluvac*.html
Disallow */pidkladka*.html
Disallow */membrane-*.html
Disallow */mistkist*.html
Disallow */dovzina-*-*.html
Disallow */pidtrimka-*.html
Disallow */tehnologia-*.html
Disallow */dominuucij_material-*.html
Disallow */print-*.html
Disallow */priaznij_do_navkolisnogo_seredovisa-*.html
Disallow */etiketka-*.html
Disallow */harakteristiki_kurtki-*.html
Disallow */stil_*.html
Disallow */napovnenna*.html
Disallow */zahist_vid_holodu*.html
Disallow */zahist_vid_opadiv*.html
Disallow */kiseni*.html
Disallow */kriplenna*.html
Disallow */dekolte*.html
Disallow */pogodni_umovi*.html
Disallow */filtr*.html
Disallow */stanini*.html
Disallow */rtip_obladnanna*.html
Disallow */tip_zadnoi_castini*.html
Disallow */talia*.html
Disallow */zahist_ocej*.html
Disallow */kharakteristiki_kurtki*.html
Disallow */tekhnologia*.html
Disallow */kategorii*
Disallow */kategorie*
Disallow */newsletters*
Disallow */newsletterowe*
Disallow */special_price_*.html
Disallow *.html/1000

screaming frog

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://4f.ua/sitemap_ua_index.xml

Comments

  • strony
  • filtry
  • kat. mrkt i stare
  • boty, którym opóźniamy zapytania
  • boty blokowane