Log In Sign Up

locticians.com
robots.txt

Robots Exclusion Standard data for locticians.com

Resource Scan

Scan Details

Site Domain locticians.com
Base Domain locticians.com
Scan Status Ok
Last Scan2025-10-18T20:48:46+00:00
Next Scan 2025-10-25T20:48:46+00:00

Last Scan

Scanned2025-10-18T20:48:46+00:00
URL https://locticians.com/robots.txt
Domain IPs 66.147.238.50
Response IP 66.147.238.50
Found Yes
Hash cd5e364af9ffb19c85e05c3e4ee515460db1d5ad7a4c38b3541f1f969862fe53
SimHash 50125b43eeaf

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

googleother

Rule Path
Allow /

googleother-image

Rule Path
Allow /

bingbot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

applebot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

sogou spider

Rule Path
Allow /

petalbot

Rule Path
Allow /

seznambot

Rule Path
Allow /

yeti

Rule Path
Allow /

naverbot

Rule Path
Allow /

qwantify

Rule Path
Allow /

twitterbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

facebot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

pinterestbot

Rule Path
Allow /

slackbot

Rule Path
Allow /

discordbot

Rule Path
Allow /

whatsapp

Rule Path
Allow /

telegrambot

Rule Path
Allow /

snapchatbot

Rule Path
Allow /

embedly

Rule Path
Allow /

semrushbot

Rule Path
Allow /

semrushbot-sa

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

dotbot

Rule Path
Allow /

rogerbot

Rule Path
Allow /

mj12bot

Rule Path
Allow /

sitebulb

Rule Path
Allow /

screaming frog seo spider

Rule Path
Allow /

oncrawlbot

Rule Path
Allow /

rytebot

Rule Path
Allow /

seokicks-robot

Rule Path
Allow /

gptbot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

applebot-extended

Rule Path
Allow /

ccbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

bytespider

Rule Path
Allow /

amazonbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

youbot

Rule Path
Allow /

*

Rule Path
Allow /
Disallow /admin/
Disallow /login/
Disallow /register/
Disallow /api/
Disallow /private/
Disallow /tmp/
Disallow /cgi-bin/
Back to top

Other Records

Field Value
sitemap https://locticians.com/filedata/cache/xml-sitemaps/sitemap.xml
Back to top

Comments

  • robots.txt for locticians.com
  • MAX-OPEN: allow discovery by search engines, SEO tools, social preview bots, and ALL AI/model/chat crawlers.
  • Only block truly sensitive/admin areas.
  • Major search engines
  • Social & link preview bots
  • SEO & auditing crawlers
  • AI / chat / model training crawlers (UNBLOCKED)
  • Default rules (keep private areas protected)
  • Sitemap
Back to top