sklep.ke.pl
robots.txt

Robots Exclusion Standard data for sklep.ke.pl

Resource Scan

Scan Details

Site Domain sklep.ke.pl
Base Domain ke.pl
Scan Status Ok
Last Scan2025-09-09T02:51:25+00:00
Next Scan 2025-09-23T02:51:25+00:00

Last Scan

Scanned2025-09-09T02:51:25+00:00
URL https://sklep.ke.pl/robots.txt
Domain IPs 23.45.207.37, 23.45.207.38, 2600:1413:3800:56::172d:cf46, 2600:1413:3800:56::172d:cf47, 2600:1413:3800:56::172d:cf56
Response IP 23.58.144.141
Found Yes
Hash 8a574da835c2e8f4a42533f6e2384410d283e830c2e2d4bdfe6fcfdbc82101f0
SimHash cd2cf18fc699

Groups

semrushbot

Rule Path
Disallow /amfile/file/

amazonbot

Rule Path
Disallow /amfile/file/

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /404/
Disallow /admin/
Disallow /api/
Disallow /rest/V1/
Disallow /cgi-bin/
Disallow /media/email/
Disallow /media/sales/
Disallow /media/customer/
Disallow /media/downloadable/
Disallow /media/amasty/amfile/
Disallow /enable-cookies
Disallow /index.php/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalog/product/gallery/
Disallow /catalogsearch/
Disallow /customer/
Disallow /checkout/
Disallow /newsletter/
Disallow /poll/
Disallow /review/
Disallow /sendfriend/
Disallow /tag/
Disallow /wishlist/
Disallow /.user.ini
Disallow /get.php
Disallow /*.php$
Disallow /*?SID=
Disallow /*?id=
Disallow /*?dir=
Disallow /*?order=
Disallow /*?__store=
Disallow /*?product_list_dir=
Disallow /*?product_list_order=
Disallow /*?product_list_limit=
Disallow /checkout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://sklep.ke.pl/media/sitemap.xml

Comments

  • Rule 1/2
  • Rule 2/2