4f.com.pl
robots.txt

Robots Exclusion Standard data for 4f.com.pl

Resource Scan

Scan Details

Site Domain 4f.com.pl
Base Domain 4f.com.pl
Scan Status Ok
Last Scan2024-11-04T12:56:04+00:00
Next Scan 2024-11-18T12:56:04+00:00

Last Scan

Scanned2024-11-04T12:56:04+00:00
URL https://4f.com.pl/robots.txt
Domain IPs 23.215.7.22, 23.215.7.7, 2600:1413:b000:1b::17d7:707, 2600:1413:b000:1b::17d7:716
Response IP 96.17.180.46
Found Yes
Hash c45d28fe25c4a9b4de3015f37a3bdcdc6b11b47461bb444e033f4157f4b4f94c
SimHash 25195cd08bd3

Groups

*

Rule Path
Disallow /customer/*
Disallow /*regulamin*
Disallow /cms/page/view/page_id/2082
Disallow /polityka-cookies
Disallow /wishlist/
Disallow /admin/
Disallow /checkout*
Disallow /home
Disallow /index.php
Disallow /catalog/category/*
Disallow */searchcatalog*
Disallow */search*
Disallow /wyszukiwanie?*
Disallow */kategorie*
Disallow */newsletterowe*
Disallow */sezony/*.html
Disallow */kampanie/*.html
Disallow */thank-you-page-newsletter*
Disallow */cena-*-*.html
Disallow */kolory-*-*.html
Disallow */rozmiar-*-*.html
Disallow */kroj-*-*.html
Disallow */dyscyplina*.html
Disallow */cechy*.html
Disallow */wodoszczelnosc*.html
Disallow */oddychalnosc*.html
Disallow */plec-*-*.html
Disallow */wysokosc_cholewy*.html
Disallow */kaptur*.html
Disallow */ocieplenie*.html
Disallow */ocieplina*.html
Disallow */podszewka*.html
Disallow */membrana*.html
Disallow */pojemnosc*.html
Disallow */dlugosc-*-*.html
Disallow */wsparcie*.html
Disallow */technologia-*.html
Disallow */material_dominujacy*.html
Disallow */wzor*.html
Disallow */zrownowazony_rozwoj*.html
Disallow */kolekcja-*.html
Disallow */styl_*.html
Disallow */wypelnienie*.html
Disallow */ochrona_przed_chlodem*.html
Disallow */ochrona_przed_opadami*.html
Disallow */kieszenie*.html
Disallow */zapiecie*.html
Disallow */rodzaj_suplementu*.html
Disallow */smak*.html
Disallow */wlasciwosci*.html
Disallow */postac_produktu*.html
Disallow */opakowanie*.html
Disallow */typ_*.html
Disallow */dekolt*.html
Disallow */kategoria_produktowa*.html
Disallow */material*-*.html
Disallow */grupa_wiekowa*.html
Disallow */warunki_pogodowe*.html
Disallow */sezon-*.html
Disallow */linia-*.html
Disallow */filtr*.html
Disallow */nogawki*.html
Disallow */przeznaczenie*.html
Disallow */rodzaj_*.html
Disallow */talia*.html
Disallow */system_wymiennych_szybek*.html
Disallow */ochrona_oczu*.html
Disallow */producent-*.html
Disallow */marka-*.html
Disallow */newsletters*
Disallow */odzie/*
Disallow */nakrycia_owy/*
Disallow */odzie-dziewcz-ca/*
Disallow */odzie-ska/*
Disallow */cena_specjalna*.html
Disallow */special_price_*.html
Disallow *.html/1000

screaming frog

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandeximages

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://4f.com.pl/sitemap_pl_index.xml

Comments

  • filtry
  • old
  • delayed bots
  • bad bots