ballzy.eu
robots.txt

Robots Exclusion Standard data for ballzy.eu

Resource Scan

Scan Details

Site Domain ballzy.eu
Base Domain ballzy.eu
Scan Status Ok
Last Scan2024-09-22T10:22:57+00:00
Next Scan 2024-10-22T10:22:57+00:00

Last Scan

Scanned2024-09-22T10:22:57+00:00
URL https://ballzy.eu/robots.txt
Redirect https://ballzy.eu/en/robots.txt
Domain IPs 104.22.50.156, 104.22.51.156, 172.67.31.75, 2606:4700:10::6816:329c, 2606:4700:10::6816:339c, 2606:4700:10::ac43:1f4b
Response IP 172.67.31.75
Found Yes
Hash ea0064ddef6695bf54b102fcfb3a76af2c244ead55b5ec589c22886aa60d93b6
SimHash 4a78bd61ead9

Groups

*

Rule Path
Disallow /*size%3D*
Disallow /*color%3D*
Disallow /*price%3D*
Disallow /est/shop/category/*
Disallow /est/shop/brand/*
Disallow /lat/shop/kollektsioon/*
Disallow /*customer/*
Disallow /customer/account/
Disallow /customer/account/login/
Disallow *limegrow_quickview/catalog_product/*
Disallow /checkout/
Disallow */no-route/
Disallow */noroute/

Other Records

Field Value
crawl-delay 15

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Comments

  • Crawl-delay: 15
  • Disallow: /*size=*
  • Disallow: /*color=*
  • Disallow: /*price=*
  • Disallow: /est/shop/category/*
  • Disallow: /est/shop/brand/*
  • Disallow: /lat/shop/kollektsioon/*
  • Disallow: /*customer/*
  • Disallow: /*size=*
  • Disallow: /*color=*
  • Disallow: /*price=*
  • User-agent: Screaming Frog SEO Spider
  • Disallow: /