Log In Sign Up

zixflow.com
robots.txt

Robots Exclusion Standard data for zixflow.com

Resource Scan

Scan Details

Site Domain zixflow.com
Base Domain zixflow.com
Scan Status Ok
Last Scan2025-10-24T03:10:05+00:00
Next Scan 2025-11-23T03:10:05+00:00

Last Scan

Scanned2025-10-24T03:10:05+00:00
URL https://zixflow.com/robots.txt
Domain IPs 13.203.125.58, 13.233.175.166, 3.109.243.18
Response IP 3.109.243.18
Found Yes
Hash d5ffbe86815329ec8d2f068dd24ee7d2197e837e4aad0cd15b9be619be3aa1c4
SimHash 713c497064b9

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

bingbot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

msnbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

claude-web

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

perplexity-user

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

pinterestbot

Rule Path
Allow /

applebot

Rule Path
Allow /

google-adwords

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

google-adsense

Rule Path
Allow /

google-site-verification

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

moz dotbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefs site audit

Rule Path
Disallow /

semrushbot-ocob

Rule Path
Disallow /

addthis

Rule Path
Disallow /

detectify

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

pingdom

Rule Path
Disallow /

gtmetrix

Rule Path
Disallow /

*

Rule Path
Disallow /
Disallow /admin/
Disallow /private/
Disallow /tmp/
Disallow /logs/
Disallow /cache/
Disallow /backup/
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/uploads/
Disallow /search/
Disallow /?s=
Disallow /feed/
Disallow /feeds/
Disallow /trackback/
Disallow /*?
Disallow /*.pdf$
Disallow /*.doc$
Disallow /*.docx$
Disallow /*.xls$
Disallow /*.xlsx$
Allow /wp-admin/admin-ajax.php
Allow /wp-content/themes/
Allow /wp-content/plugins/
Allow /.well-known/
Back to top

Other Records

Field Value
sitemap https://zixflow.com/sitemap.xml
Back to top

Comments

  • Bandwidth Optimized June 2025
  • Purpose: Allow essential bots (Search, AI, Social) & block unwanted scrapers
  • ======= ALLOW: Search Engines (High SEO Value) =======
  • ======= ALLOW: Verified AI Bots =======
  • ======= ALLOW: Social Media & Previews =======
  • ======= ALLOW: Google Services =======
  • ======= ALLOW: Archive.org =======
  • ======= BLOCK: SEO Scrapers, AI Crawlers Not Needed =======
  • ======= DEFAULT: Block Unknown Bots =======
  • ======= Block Common Private or Sensitive Directories =======
  • ======= Allow Required Assets =======
Back to top