Log In Sign Up

asiaflash.com
robots.txt

Robots Exclusion Standard data for asiaflash.com

Resource Scan

Scan Details

Site Domain asiaflash.com
Base Domain asiaflash.com
Scan Status Ok
Last Scan2026-01-16T07:47:59+00:00
Next Scan 2026-01-23T07:47:59+00:00

Last Scan

Scanned2026-01-16T07:47:59+00:00
URL https://asiaflash.com/robots.txt
Redirect https://www.asiaflash.com/robots.txt
Redirect Domain www.asiaflash.com
Redirect Base asiaflash.com
Domain IPs 2001:41d0:8:8644::1, 87.98.151.145
Redirect IPs 2001:41d0:8:8644::1, 87.98.151.145
Response IP 87.98.151.145
Found Yes
Hash 93058cc74140eb1fe7d0d9fcc77d233f16094ee3391ae795df43beccbbb72aae
SimHash 50141f4267f4

Groups

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

semrushbot

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

serpstatbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

wget

Rule Path
Disallow /

curl

Rule Path
Disallow /

java

Rule Path
Disallow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.asiaflash.com/sitemap.xml
Back to top

Comments

  • Robots.txt optimisé
  • SEO-friendly + respect IA sélectionnée
  • --- Autoriser les moteurs légitimes ---
  • --- Autoriser les outils SEO professionnels ---
  • (Note : DotBot = Ahrefs, doublon non nécessaire)
  • --- Autoriser explicitement les bots OpenAI ---
  • --- Bloquer les IA parasites et scrapers agressifs ---
  • --- Bloquer les scrapers génériques ---
  • --- Règle par défaut pour les autres robots ---
  • --- Sitemap ---
Back to top