4fstore.ro
robots.txt

Robots Exclusion Standard data for 4fstore.ro

Resource Scan

Scan Details

Site Domain 4fstore.ro
Base Domain 4fstore.ro
Scan Status Ok
Last Scan2024-06-19T10:45:17+00:00
Next Scan 2024-07-03T10:45:17+00:00

Last Scan

Scanned2024-06-19T10:45:17+00:00
URL https://4fstore.ro/robots.txt
Domain IPs 2600:1417:3f::b81c:eb51, 2600:1417:3f::b81c:eb71, 96.17.180.45, 96.17.180.46
Response IP 125.56.219.2
Found Yes
Hash 2978f37bb0b75d1355eee23f085d3fd2985b256e7617077e420c5a2e9baf1b6e
SimHash 2919588b8ef3

Groups

*

Rule Path
Disallow /customer/*
Disallow /regulament
Disallow /cms/page/view/page_id/2082
Disallow /cookie-declaration-ro
Disallow /informatii-despre-modificarea-regulamentului
Disallow /avantaje-d-epe-urma-inregistrarii
Disallow /avantajele-e-cumparaturilor
Disallow /politica-de-confidentialitate
Disallow /regulamentele-promotiilor
Disallow /declara-ia-de-conformitate
Disallow /informatii-despre-sanctiuni
Disallow /wishlist/
Disallow /admin/
Disallow /checkout*
Disallow /home
Disallow /index.php
Disallow /catalog/category/*
Disallow */catalogsearch*
Disallow */search*
Disallow *.html/1000
Disallow */pret-*-*.html
Disallow */culoarea-*-*.html
Disallow */marime-*-*.html
Disallow */croiala-*-*.html
Disallow */sport-*.html
Disallow */caracteristici*.html
Disallow */impermeabilitate*.html
Disallow */respirabilitate*.html
Disallow */sex-*.html
Disallow */sex-*-*.html
Disallow */inaltimea_carambului*.html
Disallow */gluga*.html
Disallow */umplutura*.html
Disallow */captuseala*.html
Disallow */capacitate*.html
Disallow */lungime-*-*.html
Disallow */suport*.html
Disallow */tehnologie-*.html
Disallow */material_de_baza*.html
Disallow */motiv*.html
Disallow */dezvoltare_durabila*.html
Disallow */caracteristicile*.html
Disallow */tip_*.html
Disallow */protectie_impotriva_frigului*.html
Disallow */buzunare*.html
Disallow */inchidere*.html
Disallow */decolteu-in*.html
Disallow */decolteu*.html
Disallow */conditiile_atmosferice*.html
Disallow */filtru*.html
Disallow */craci*.html
Disallow */talie*.html
Disallow */sistem_de_lentile_interschimbabile*.html
Disallow */protectia_ochilor*.html
Disallow */protectie_impotriva_precipitatiilor*.html
Disallow */product_style*.html
Disallow */special_price_*.html
Disallow */cena_specjalna*.html
Disallow */categorii*
Disallow */newsletters*
Disallow */newsletterowe*

screaming frog

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandeximages

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /phpserver/
Disallow /pub/
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*

Other Records

Field Value
sitemap https://4fstore.ro/sitemap_ro_index.xml

Comments

  • filtry
  • old
  • delayed bots
  • bad bots
  • old