odziejsie.pl
robots.txt

Robots Exclusion Standard data for odziejsie.pl

Resource Scan

Scan Details

Site Domain odziejsie.pl
Base Domain odziejsie.pl
Scan Status Ok
Last Scan2024-09-23T16:07:54+00:00
Next Scan 2024-10-23T16:07:54+00:00

Last Scan

Scanned2024-09-23T16:07:54+00:00
URL https://odziejsie.pl/robots.txt
Redirect https://www.odziejsie.pl/robots.txt
Redirect Domain www.odziejsie.pl
Redirect Base odziejsie.pl
Domain IPs 5.149.163.164
Redirect IPs 5.149.163.164
Response IP 5.149.163.164
Found Yes
Hash d8d9a9fceca3f8aee53ef379d8ecb44df81c830ae7c38439f3278af3ef767a8d
SimHash 528490dba51b

Groups

*

Rule Path
Disallow /*?rec=*
Disallow /*%26rec%3D*

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fyberspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

twengabot-discover

Rule Path
Disallow /

twengabot/2.0

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

twengabot-2.0

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Disallow /*/affiliate-calculations.html
Disallow /*/affiliate-clients.html
Disallow /*/affiliate-generator.html
Disallow /*/affiliate-main.html
Disallow /*/affiliate-orders.html
Disallow /*/affiliate-resources.html
Disallow /*/affiliate-stats.html
Disallow /*/basketchange.html
Disallow /*/basketedit.html
Disallow /*/basket-onchange.html
Disallow /*/checkup.html
Disallow /*/client-address.html
Disallow /*/client-addresses.html
Disallow /*/client-files.html
Disallow /*/client-new.html
Disallow /*/client-orders.html
Disallow /*/client-rebate.html
Disallow /*/client-save.html
Disallow /*/download-attachment.html
Disallow /edi/
Disallow /*/login.html
Disallow /*/loginedit.html
Disallow /*/loginonce.html
Disallow /*/membership-card.html
Disallow /*/newsletter.html
Disallow /*/order1.html
Disallow /*/order2.html
Disallow /*/order3.html
Disallow /*/ordercancel.html
Disallow /*/orderconfirm.html
Disallow /*/orderdetails.html
Disallow /*/order-document.html
Disallow /*/order-newpayment.html
Disallow /*/order-open.html
Disallow /*/order-payment.html
Disallow /*/order-postauction.html
Disallow /*/order-wrappers.html
Disallow /*/password-recover.html
Disallow /*/payments-confirm.html
Disallow /*/product-compare.html
Disallow /*/products-bought.html
Disallow /*/products-requests.html
Disallow /*/przelew.html
Disallow /*/rebate-code.html
Disallow /*/return.html
Disallow /*/returns-open.html
Disallow /*/rma-add.html
Disallow /*/rma-list.html
Disallow /*/rma-open.html
Disallow /*/search?text=
Disallow /*/search.html
Disallow /*/searching.html
Disallow /*/settings.html
Disallow /*/shoppinglist
Disallow /*/signin.html
Disallow /ajax/
Disallow /pl/product-stocks.html
Disallow /product-stock.php
Disallow /pl/terms/polityka-dotyczaca-cookies-14.html
Disallow /pl/about/koszty-wysylki-22.html
Disallow /*/categories/
Disallow /basketchange.php
Disallow /*?filter

Other Records

Field Value
sitemap https://www.odziejsie.pl/sitemap.xml.gz

Comments

  • Pages with rec parameter - IAI Recommendation System
  • Automatically banned scanners and crawlers section
  • Section end

Warnings

  • 2 invalid lines.