4fstore.lv
robots.txt

Robots Exclusion Standard data for 4fstore.lv

Resource Scan

Scan Details

Site Domain 4fstore.lv
Base Domain 4fstore.lv
Scan Status Ok
Last Scan2024-06-16T15:48:57+00:00
Next Scan 2024-06-30T15:48:57+00:00

Last Scan

Scanned2024-06-16T15:48:57+00:00
URL https://4fstore.lv/robots.txt
Domain IPs 23.52.40.58, 23.52.40.59, 2600:1417:3f::b81c:eb51, 2600:1417:3f::b81c:eb71
Response IP 96.17.180.46
Found Yes
Hash 759dd99ced16eab0e77a2aea02d7bb3556fab220c2f1e864e76712a56f6e3a11
SimHash b5915898aa13

Groups

*

Rule Path
Disallow /customer/*
Disallow /noteikumi
Disallow /informacija-par-noteikumus-grozijumiem
Disallow /privatuma-un-sikdatnu-politika
Disallow /promoakcijas-noteikumi
Disallow /atbilstibas-deklaracijas
Disallow /informacija-saistiba-ar-sankcijam
Disallow /cms/page/view/page_id/2082
Disallow /wishlist/
Disallow /admin/
Disallow /checkout*
Disallow /home
Disallow /index.php
Disallow /catalog/category/*
Disallow */catalogsearch*
Disallow */search*
Disallow *.html/1000
Disallow */cena-*-*.html
Disallow */krekli-un-krekli-*-*.html
Disallow */apavu_ipasibas-*-*.html
Disallow */cepures_ipasibas-*-*.html
Disallow */apaksvelas_ipasibas-*-*.html
Disallow */biksu_ipasibas-*-*.html
Disallow */krasas-*-*.html
Disallow */izmers-*-*.html
Disallow */fasons-*-*.html
Disallow */sporta_veids*.html
Disallow */*raksturliknes*.html
Disallow */udensnecaurlaidiba*.html
Disallow */elpojamiba*.html
Disallow */dzimums-*-*.html
Disallow */stulma_augstums*.html
Disallow */kapuce*.html
Disallow */sildammaterials*.html
Disallow */odere*.html
Disallow */tilpums*.html
Disallow */garums-*-*.html
Disallow */atbalsts*.html
Disallow */tehnologija-*.html
Disallow */dominejosais_materials*.html
Disallow */raksts*.html
Disallow */lidzsvarota_attistiba*.html
Disallow */virsjakas_ipasibas-*.html
Disallow */*stils*.html
Disallow */pildijums*.html
Disallow */aizsardziba_pret_aukstumu*.html
Disallow */aizsardziba_pret_nokrisniem*.html
Disallow */kabatas*.html
Disallow */aizdare*.html
Disallow */product_style*.html
Disallow */dekolte*.html
Disallow */laika_apstakli*.html
Disallow */filtrs*.html
Disallow */kajas*.html
Disallow */aprikojuma_veids*.html
Disallow */aizmugurejas_dalas_tips*.html
Disallow */viduklis*.html
Disallow */mainamu_stiklu_sistema*.html
Disallow */acu_aizsardziba*.html
Disallow */produkta_tips*.html
Disallow */special_price_*.html
Disallow */strona-*.html
Disallow */cena_specjalna*.html
Disallow */kleitas_ipasibas-*-*.html
Disallow */bagazas_ipasibas-*-*.html
Disallow */pamusalas-*-*.html
Disallow */sleposanas_brillu_ipasibas-*-*.html
Disallow */cimdu_ipasibas*.html
Disallow */sleposanas_brillu_ipasibas*.html
Disallow */kategorijas*
Disallow */newsletters*
Disallow */newsletterowe*

screaming frog

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandeximages

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://4fstore.lv/sitemap_lv_index.xml

Comments

  • filtry
  • kat. mrkt i stare
  • boty, którym opóźniamy zapytania
  • boty blokowane