supersklep.pl
robots.txt

Robots Exclusion Standard data for supersklep.pl

Resource Scan

Scan Details

Site Domain supersklep.pl
Base Domain supersklep.pl
Scan Status Ok
Last Scan2024-10-02T18:45:43+00:00
Next Scan 2024-11-01T18:45:43+00:00

Last Scan

Scanned2024-10-02T18:45:43+00:00
URL https://supersklep.pl/robots.txt
Domain IPs 92.223.84.84
Response IP 92.223.84.84
Found Yes
Hash 8a155a41473a04fd7d681196cd0d7261b4b3eddf0b773295817166e09298a04d
SimHash c0f17bc9cf33

Groups

*

Rule Path
Disallow /*.phtml$
Disallow /stats/
Disallow /share/
Disallow /hidden/
Disallow /catalog/
Disallow /checkout/
Disallow /account/
Disallow /webpage/
Disallow /szukaj/
Disallow /public/
Disallow /*/switch_sex-F*
Disallow /*/switch_sex-C*
Disallow /*/switch_sex-M*
Disallow */specials-1*
Disallow */sort-*a*
Disallow */sort-*d*
Disallow */v-1
Disallow */v-2
Disallow /*?*qs=
Allow /catalog/page/brand

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://supersklep.pl/google/sitemap