Log In Sign Up

bluefox.lt
robots.txt

Robots Exclusion Standard data for bluefox.lt

Resource Scan

Scan Details

Site Domain bluefox.lt
Base Domain bluefox.lt
Scan Status Ok
Last Scan2026-02-15T12:37:50+00:00
Next Scan 2026-03-17T12:37:50+00:00

Last Scan

Scanned2026-02-15T12:37:50+00:00
URL https://bluefox.lt/robots.txt
Redirect https://www.bluefox.lt/robots.txt
Redirect Domain www.bluefox.lt
Redirect Base bluefox.lt
Domain IPs 104.21.40.147, 172.67.153.12, 2606:4700:3031::ac43:990c, 2606:4700:3032::6815:2893
Redirect IPs 104.21.40.147, 172.67.153.12, 2606:4700:3031::ac43:990c, 2606:4700:3032::6815:2893
Response IP 172.67.153.12
Found Yes
Hash 8a432e7b2e736581f2b0a848213ff6f93dadfdb78c29ad146bdbecdbf76e6974
SimHash 351df071ea54

Groups

yandex

Rule Path
Allow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

petalbot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /admin/
Disallow /briedysadmin/
Disallow /zc_install/
Disallow /cache/
Disallow /includes/
Disallow /tmp/
Disallow /logs/
Disallow /download/
Disallow /media/
Disallow /pub/
Disallow /user/
Disallow /login/
Disallow /logout/
Disallow /checkout/
Disallow /shopping_cart/
Disallow /account/
Disallow /account_history/
Disallow /password_forgotten/
Disallow /products_all.html?disp_order=1&page=all
Back to top

Other Records

Field Value
sitemap https://www.bluefox.lt/sitemap.xml
sitemap https://www.bluefox.lt/sitemap/sitemapcategories.xml
sitemap https://www.bluefox.lt/sitemap/sitemapmainpage.xml
sitemap https://www.bluefox.lt/sitemap/sitemapmanufacturers.xml
sitemap https://www.bluefox.lt/sitemap/sitemapproducts.xml
Back to top

Comments

  • ============================================
  • Robots.txt для интернет-магазина Zen Cart
  • Оптимизировано: Bluefox.lt, 2026
  • СоÑ
  • ============================================
  • --------------------------------------------
  • 1. Специальные правила для Yandex
  • --------------------------------------------
  • --------------------------------------------
  • 2. Разрешаем доступ основным поисковым системам
  • --------------------------------------------
  • Google
  • Bing / Microsoft
  • Amazon Alexa
  • Huawei Petal Search
  • OpenAI SearchBot (только поиск, не обучение)
  • --------------------------------------------
  • 3. Блокируем AI-краулеры (обучающие модели)
  • --------------------------------------------
  • OpenAI training bot
  • Meta AI
  • Anthropic Claude
  • Perplexity AI
  • ByteDance / TikTok
  • ChatGPT user agent (через плагины)
  • --------------------------------------------
  • 4. Общие правила для всеÑ
  • --------------------------------------------
  • --------------------------------------------
  • 5. XML Sitemap
  • --------------------------------------------
Back to top

Warnings

  • 3 invalid lines.
  • `clean-param` is not a known field.
Back to top