4fstore.com
robots.txt

Robots Exclusion Standard data for 4fstore.com

Resource Scan

Scan Details

Site Domain 4fstore.com
Base Domain 4fstore.com
Scan Status Ok
Last Scan2024-11-04T04:28:19+00:00
Next Scan 2024-11-18T04:28:19+00:00

Last Scan

Scanned2024-11-04T04:28:19+00:00
URL https://4fstore.com/robots.txt
Domain IPs 23.215.7.22, 23.215.7.7, 2600:1413:b000:1b::17d7:707, 2600:1413:b000:1b::17d7:716
Response IP 23.215.7.22
Found Yes
Hash 226552bc29f128c33840b733924355d98140163fc74d8481613ddbf592175c38
SimHash ad9939a3ae54

Groups

*

Rule Path
Disallow /customer/*
Disallow /terms-and-conditions
Disallow /information-about-changing-terms
Disallow /cookie-policy
Disallow /declaration-of-conformity
Disallow /information-about-sanctions
Disallow /cms/page/view/page_id/2082
Disallow /wishlist/
Disallow /admin/
Disallow /checkout*
Disallow /home
Disallow /index.php
Disallow /catalog/category/*
Disallow */searchcatalog*
Disallow *.html/1000
Disallow */precipitation_protection-*-*.html
Disallow */price-*-*.html
Disallow */colors-*-*.html
Disallow */size-*-*.html
Disallow */fit-*-*.html
Disallow */discipline*.html
Disallow */*features*.html
Disallow */waterproofness*.html
Disallow */breathability*.html
Disallow */sex-*.html
Disallow */sex-*-*.html
Disallow */shoe_height*.html
Disallow */hood-*.html
Disallow */insulation*.html
Disallow */lining*.html
Disallow */capacity*.html
Disallow */length-*-*.html
Disallow */support*.html
Disallow */technology-*.html
Disallow */main_fabric*.html
Disallow */pattern*.html
Disallow */sustainability*.html
Disallow */*_style*.html
Disallow */protection_from_cold*.html
Disallow */protection_against_rainfall*.html
Disallow */pockets*.html
Disallow */fastener*.html
Disallow */product_style*.html
Disallow */neckline*.html
Disallow */weather_conditions*.html
Disallow */filter*.html
Disallow */legs*.html
Disallow */type_of_equipment*.html
Disallow */type_of_the_back*.html
Disallow */waistline*.html
Disallow */interchangeable_lens_system*.html
Disallow */eye_protection*.html
Disallow */special_price_*.html
Disallow */cena_specjalna*.html
Disallow */manufacturer-*.html
Disallow */categories*
Disallow */newsletters*
Disallow */newsletterowe*

screaming frog

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandeximages

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://4fstore.com/sitemap_en_index.xml

Comments

  • filtry
  • kat. mrkt i stare
  • boty, którym opóźniamy zapytania
  • boty blokowane