Log In Sign Up

alicart.com
robots.txt

Robots Exclusion Standard data for alicart.com

Resource Scan

Scan Details

Site Domain alicart.com
Base Domain alicart.com
Scan Status Ok
Last Scan2026-01-20T04:24:18+00:00
Next Scan 2026-02-19T04:24:18+00:00

Last Scan

Scanned2026-01-20T04:24:18+00:00
URL https://alicart.com/robots.txt
Redirect https://www.alicart.com/robots.txt
Redirect Domain www.alicart.com
Redirect Base alicart.com
Domain IPs 104.26.4.53, 104.26.5.53, 172.67.71.19, 2606:4700:20::681a:435, 2606:4700:20::681a:535, 2606:4700:20::ac43:4713
Redirect IPs 104.26.4.53, 104.26.5.53, 172.67.71.19, 2606:4700:20::681a:435, 2606:4700:20::681a:535, 2606:4700:20::ac43:4713
Response IP 104.26.5.53
Found Yes
Hash c2d81831882aebbd71e0bd0f166111a1295f9850be276fd3a5ca9df8a5b60f1c
SimHash 38151dc1e7eb

Groups

googlebot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

applebot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

pinterestbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

claudebot

Rule Path
Allow /

ccbot

Rule Path
Allow /

siteauditbot

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top

Comments

  • ============================
  • CORE SEARCH ENGINES
  • ============================
  • ============================
  • SOCIAL PREVIEW BOTS
  • ============================
  • ============================
  • AI / GEO CRAWLERS (EXPLICITLY ALLOWED)
  • ============================
  • ============================
  • ALLOW OPTIONAL SEO AUDIT TOOLS
  • ============================
  • ============================
  • BLOCK HIGH-ABUSE SCRAPERS
  • ============================
  • ============================
  • BLOCK EVERYTHING ELSE
  • ============================
  • ============================
  • SITEMAP
  • ============================
  • Sitemap: https://www.alicart.com/sitemap.xml
Back to top