megadron.pl
robots.txt

Robots Exclusion Standard data for megadron.pl

Resource Scan

Scan Details

Site Domain megadron.pl
Base Domain megadron.pl
Scan Status Ok
Last Scan2024-09-24T08:12:36+00:00
Next Scan 2024-10-24T08:12:36+00:00

Last Scan

Scanned2024-09-24T08:12:36+00:00
URL https://megadron.pl/robots.txt
Domain IPs 5.149.167.72
Response IP 5.149.167.72
Found Yes
Hash 835920fa0f8ac17c14e3c9d2279797339bd7e4e13b13d6da37e2b8cd71fba828
SimHash 9254925a06bb

Groups

*

Rule Path
Disallow /*?rec=*
Disallow /*%26rec%3D*

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fyberspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

twengabot-discover

Rule Path
Disallow /

twengabot/2.0

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

twengabot-2.0

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Allow /*?rec=*
Allow /*%26rec%3D*
Disallow /en/basketchange.html
Disallow /pl/basketchange.html
Disallow /uk/basketchange.html
Disallow /en/basketedit.html
Disallow /pl/basketedit.html
Disallow /uk/basketedit.html
Disallow /en/basket-onchange.html
Disallow /pl/basket-onchange.html
Disallow /uk/basket-onchange.html
Disallow /en/client-address.html
Disallow /pl/client-address.html
Disallow /uk/client-address.html
Disallow /en/client-addresses.html
Disallow /pl/client-addresses.html
Disallow /uk/client-addresses.html
Disallow /en/client-new.html
Disallow /pl/client-new.html
Disallow /uk/client-new.html
Disallow /en/client-orders.html
Disallow /pl/client-orders.html
Disallow /uk/client-orders.html
Disallow /en/client-save.html
Disallow /pl/client-save.html
Disallow /uk/client-save.html
Disallow /en/client-files.html
Disallow /pl/client-files.html
Disallow /uk/client-files.html
Disallow /en/download-attachment.html
Disallow /pl/download-attachment.html
Disallow /uk/download-attachment.html
Disallow /en/login.html
Disallow /pl/login.html
Disallow /uk/login.html
Disallow /en/loginedit.html
Disallow /pl/loginedit.html
Disallow /uk/loginedit.html
Disallow /en/loginonce.html
Disallow /pl/loginonce.html
Disallow /uk/loginonce.html
Disallow /en/membership-card.html
Disallow /pl/membership-card.html
Disallow /uk/membership-card.html
Disallow /en/order1.html
Disallow /pl/order1.html
Disallow /uk/order1.html
Disallow /en/order2.html
Disallow /pl/order2.html
Disallow /uk/order2.html
Disallow /en/order3.html
Disallow /pl/order3.html
Disallow /uk/order3.html
Disallow /en/ordercancel.html
Disallow /pl/ordercancel.html
Disallow /uk/ordercancel.html
Disallow /en/orderconfirm.html
Disallow /pl/orderconfirm.html
Disallow /uk/orderconfirm.html
Disallow /en/orderdetails.html
Disallow /pl/orderdetails.html
Disallow /uk/orderdetails.html
Disallow /en/order-document.html
Disallow /pl/order-document.html
Disallow /uk/order-document.html
Disallow /en/order-newpayment.html
Disallow /pl/order-newpayment.html
Disallow /uk/order-newpayment.html
Disallow /en/order-payment.html
Disallow /pl/order-payment.html
Disallow /uk/order-payment.html
Disallow /en/order-postauction.html
Disallow /pl/order-postauction.html
Disallow /uk/order-postauction.html
Disallow /en/order-wrappers.html
Disallow /pl/order-wrappers.html
Disallow /uk/order-wrappers.html
Disallow /en/payments-confirm.html
Disallow /pl/payments-confirm.html
Disallow /uk/payments-confirm.html
Disallow /en/products-bought.html
Disallow /pl/products-bought.html
Disallow /uk/products-bought.html
Disallow /en/products-requests.html
Disallow /pl/products-requests.html
Disallow /uk/products-requests.html
Disallow /en/przelew.html
Disallow /pl/przelew.html
Disallow /uk/przelew.html
Disallow /en/rebate-code.html
Disallow /pl/rebate-code.html
Disallow /uk/rebate-code.html
Disallow /en/rma-add.html
Disallow /pl/rma-add.html
Disallow /uk/rma-add.html
Disallow /en/rma-list.html
Disallow /pl/rma-list.html
Disallow /uk/rma-list.html
Disallow /en/settings.html
Disallow /pl/settings.html
Disallow /uk/settings.html
Disallow /en/checkup.html
Disallow /pl/checkup.html
Disallow /uk/checkup.html
Disallow /en/rma-open.html
Disallow /pl/rma-open.html
Disallow /uk/rma-open.html
Disallow /en/returns-open.html
Disallow /pl/returns-open.html
Disallow /uk/returns-open.html
Disallow /en/return.html
Disallow /pl/return.html
Disallow /uk/return.html
Disallow /edi/
Disallow /ajax/
Disallow /panel/password-recover.php
Disallow /panel
Disallow /pl/affiliate-main.html
Disallow /en/affiliate-main.html
Disallow /uk/affiliate-main.html

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://megadron.pl/sitemap.xml.gz

Comments

  • Pages with rec parameter - IAI Recommendation System
  • Automatically banned scanners and crawlers section
  • Section end

Warnings

  • 2 invalid lines.