Log In Sign Up

babaphuket.com
robots.txt

Robots Exclusion Standard data for babaphuket.com

Resource Scan

Scan Details

Site Domain babaphuket.com
Base Domain babaphuket.com
Scan Status Ok
Last Scan2026-02-07T21:44:19+00:00
Next Scan 2026-03-09T21:44:19+00:00

Last Scan

Scanned2026-02-07T21:44:19+00:00
URL https://babaphuket.com/robots.txt
Domain IPs 104.21.86.7, 172.67.213.184, 2606:4700:3030::6815:5607, 2606:4700:3030::ac43:d5b8
Response IP 104.21.86.7
Found Yes
Hash 76074da0d1d4dcfbfb4d4f9b38a078d2b643ee36dcf66e31b238d8f252317bbe
SimHash 401493418566

Groups

oai-searchbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

chatgpt-user/2.0

Rule Path
Allow /

gptbot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

claudebot

Rule Path
Allow /

claude-searchbot

Rule Path
Allow /

claude-user

Rule Path
Allow /

claude-web

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

perplexity-user

Rule Path
Allow /

googlebot

Rule Path
Allow /

google-extended

Rule Path
Allow /

googleother

Rule Path
Allow /

bingbot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

applebot

Rule Path
Allow /

applebot-extended

Rule Path
Allow /

facebookbot

Rule Path
Allow /

meta-externalagent

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

bytespider

Rule Path
Allow /

duckassistbot

Rule Path
Allow /

cohere-ai

Rule Path
Allow /

ai2bot

Rule Path
Allow /

ccbot

Rule Path
Allow /

diffbot

Rule Path
Allow /

omgili

Rule Path
Allow /

timpibot

Rule Path
Allow /

youbot

Rule Path
Allow /

mistralai-user

Rule Path
Allow /

deepseekbot

Rule Path
Allow /

*

Rule Path
Disallow /lp
Disallow /feedback
Disallow /langtest
Back to top

Other Records

Field Value
sitemap https://www.babaphuket.com/sitemap.xml
Back to top

Comments

  • ===============================
  • OpenAI Crawler Controls
  • ===============================
  • อนุญาตให้ OAI-SearchBot เข้ามา เพื่อให้เว็บถูกดึงไปแสดงในผลการค้นหาของ ChatGPT
  • อนุญาตให้ ChatGPT-User เข้ามา
  • (เป็น user agent เวลาผู้ใช้ ChatGPT หรือ Custom GPT กดเข้าเว็บโดยตรง ไม่ใช่การ crawl)
  • อนุญาตให้ GPTBot เข้ามา
  • (ให้ข้อมูลถูกใช้ไปเทรน Generative AI models)
  • ===============================
  • Anthropic Crawler Controls
  • ===============================
  • ===============================
  • Perplexity Crawler Controls
  • ===============================
  • ===============================
  • Google Crawler Controls
  • ===============================
  • อนุญาต Search + AI
  • (ถ้าอยาก) อนุญาต GoogleOther สำหรับงานวิจัย/ทดสอบของกูเกิล
  • ===============================
  • Bing Crawler Controls
  • ===============================
  • ===============================
  • Amazon Crawler Controls
  • ===============================
  • ===============================
  • Apple Crawler Controls
  • ===============================
  • ===============================
  • Meta Crawler Controls
  • ===============================
  • ===============================
  • LinkedIn Crawler Controls
  • ===============================
  • ===============================
  • ByteDance / TikTok Crawler Controls
  • ===============================
  • ===============================
  • DuckDuckGo AI Crawler Controls
  • ===============================
  • ===============================
  • Cohere Crawler Controls
  • ===============================
  • ===============================
  • AI2 / Allen Institute for AI Crawler Controls
  • ===============================
  • ===============================
  • Common Crawl Bot
  • ===============================
  • ===============================
  • Diffbot Crawler Controls
  • ===============================
  • ===============================
  • Omgili Crawler Controls
  • ===============================
  • ===============================
  • Timpi AI Search
  • ===============================
  • ===============================
  • You.com Crawler Controls
  • ===============================
  • ===============================
  • Mistral AI Crawler Controls
  • ===============================
  • ===============================
  • DeepSeek Crawler Controls
  • ===============================
  • ===============================
  • Rules for Other Crawlers
  • ===============================
  • ===============================
  • Sitemap
  • ===============================
Back to top