4fstore.sk
robots.txt

Robots Exclusion Standard data for 4fstore.sk

Resource Scan

Scan Details

Site Domain 4fstore.sk
Base Domain 4fstore.sk
Scan Status Ok
Last Scan2024-11-05T12:25:18+00:00
Next Scan 2024-11-19T12:25:18+00:00

Last Scan

Scanned2024-11-05T12:25:18+00:00
URL https://4fstore.sk/robots.txt
Domain IPs 23.215.7.22, 23.215.7.7, 2600:1413:b000:1b::17d7:707, 2600:1413:b000:1b::17d7:716
Response IP 104.88.71.17
Found Yes
Hash 56f91370729e7c4c1c44e7b8c32b95b67300bcba31e9cf82355176f508c07c8c
SimHash 21ab791a8ef1

Groups

*

Rule Path
Disallow /customer/*
Disallow /obchodne-podmienky
Disallow /cms/page/view/page_id/2082
Disallow /polityka-cookies
Disallow /informacie-o-zmene
Disallow /zasady-ochrany-sukromia
Disallow /podmienky-akcii
Disallow /vyhlasenie-o-zhode
Disallow /vyhlasenie-o-zhode
Disallow /wishlist/
Disallow /admin/
Disallow /checkout*
Disallow /home
Disallow /index.php
Disallow /catalog/category/*
Disallow */searchcatalog*
Disallow */search*
Disallow *.html/1000
Disallow */druh_batoziny-*-*.html
Disallow */strih_mikiny-*-*.html
Disallow */cena-*-*.html
Disallow */farby-*-*.html
Disallow */velkost-*-*.html
Disallow */strih-*-*.html
Disallow */sport-*.html
Disallow */vlastnosti*.html
Disallow */specialne_funkcie*.html
Disallow */vodeodolnost*.html
Disallow */priedusnost*.html
Disallow */pohlavie-*-*.html
Disallow */vyska_zvrsku*.html
Disallow */kapucna*.html
Disallow */zateplenie*.html
Disallow */podsivka*.html
Disallow */objem*.html
Disallow */dlzka-*-*.html
Disallow */podpora*.html
Disallow */technologia-*.html
Disallow */dominantny_material*.html
Disallow */design*.html
Disallow */udrzatelny_rozvoj*.html
Disallow */typ_*.html
Disallow */vypln*.html
Disallow */ochrana_pred_chladom*.html
Disallow */vrecka*.html
Disallow */zapinanie*.html
Disallow */vystrih*.html
Disallow */poveternostne_podmienky*.html
Disallow */filter*.html
Disallow */druh_vybavenia*.html
Disallow */strih_zadnej_strany*.html
Disallow */pas*.html
Disallow */system_vymenitelnych_sosoviek*.html
Disallow */ochrana_oci*.html
Disallow */ochrana_pred_zrazkami*.html
Disallow */product_style*.html
Disallow */druh_vyrobku*.html
Disallow */special_price_*.html
Disallow */cena_specjalna*.html
Disallow */kategorie*
Disallow */newsletters*
Disallow */newsletterowe*

screaming frog

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandeximages

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://4fstore.sk/sitemap_sk_index.xml

Comments

  • filtry
  • old
  • delayed bots
  • bad bots