cosibella.com.ua
robots.txt

Robots Exclusion Standard data for cosibella.com.ua

Resource Scan

Scan Details

Site Domain cosibella.com.ua
Base Domain cosibella.com.ua
Scan Status Ok
Last Scan2024-10-06T09:37:32+00:00
Next Scan 2024-11-05T09:37:32+00:00

Last Scan

Scanned2024-10-06T09:37:32+00:00
URL https://cosibella.com.ua/robots.txt
Domain IPs 5.149.167.183
Response IP 5.149.167.183
Found Yes
Hash 3651bdfd9484c7860a5f3c13f77be7b5ce4d6634615e1f0f90a59525eefe4f17
SimHash 0a14b659cf33

Groups

*

Rule Path
Disallow /*?rec=*
Disallow /*%26rec%3D*

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fyberspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

twengabot-discover

Rule Path
Disallow /

twengabot/2.0

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

twengabot-2.0

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

*

Rule Path
Allow /*?rec=*
Allow /*%26rec%3D*
Disallow /ru/payments-confirm.html
Disallow /uk/payments-confirm.html
Disallow /ru/products-bought.html
Disallow /uk/products-bought.html
Disallow /ru/products-requests.html
Disallow /uk/products-requests.html
Disallow /ru/przelew.html
Disallow /uk/przelew.html
Disallow /ru/rebate-code.html
Disallow /uk/rebate-code.html
Disallow /ru/rma-add.html
Disallow /uk/rma-add.html
Disallow /ru/rma-list.html
Disallow /uk/rma-list.html
Disallow /ru/settings.html
Disallow /uk/settings.html
Disallow /ru/checkup.html
Disallow /uk/checkup.html
Disallow /ru/rma-open.html
Disallow /uk/rma-open.html
Disallow /ru/returns-open.html
Disallow /uk/returns-open.html
Disallow /sitemap.php
Disallow /panel

Other Records

Field Value
sitemap https://cosibella.com.ua/sitemap.xml.gz

Comments

  • Pages with rec parameter - IAI Recommendation System
  • Automatically banned scanners and crawlers section
  • Section end

Warnings

  • 2 invalid lines.