Log In Sign Up

blikai.com
robots.txt

Robots Exclusion Standard data for blikai.com

Resource Scan

Scan Details

Site Domain blikai.com
Base Domain blikai.com
Scan Status Ok
Last Scan2025-12-08T03:27:30+00:00
Next Scan 2026-01-07T03:27:30+00:00

Last Scan

Scanned2025-12-08T03:27:30+00:00
URL https://blikai.com/robots.txt
Redirect https://www.blikai.com/robots.txt
Redirect Domain www.blikai.com
Redirect Base blikai.com
Domain IPs 47.254.126.118
Redirect IPs 163.181.164.204, 163.181.164.205, 163.181.164.239, 163.181.164.240, 163.181.164.241, 163.181.164.242, 163.181.164.243, 163.181.164.244
Response IP 163.181.164.244
Found Yes
Hash 3dc876afa22e4e9ac864a1d83ac5596195bb67aadb177a6dc922a78f586c0e9e
SimHash 2192ab025ff9

Groups

*

Rule Path
Allow /
Disallow /en/models
Disallow /en/*
Disallow /login
Disallow /cart
Disallow /checkout
Disallow /admin
Disallow /account

gptbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

google-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

ai2bot

Rule Path
Allow /

bubing

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /
Back to top

Comments

  • robots.txt for www.blikai.com
  • Purpose: Enable AI indexing while protecting sensitive directories
  • Industry: Electronic Components Distributor
  • Allow GPTBot (OpenAI) to enable full AI indexing
  • Allow Claude AI (Anthropic)
  • Allow Google AI (Gemini / Google-Extended)
  • Allow Perplexity AI
  • Allow Amazon AI
  • General AI research crawlers
  • Bots you previously blocked (kept for safety)
Back to top