en.everybodywiki.com
robots.txt

Robots Exclusion Standard data for en.everybodywiki.com

Resource Scan

Scan Details

Site Domain en.everybodywiki.com
Base Domain everybodywiki.com
Scan Status Ok
Last Scan2026-01-29T03:09:25+00:00
Next Scan 2026-02-28T03:09:25+00:00

Last Scan

Scanned2026-01-29T03:09:25+00:00
URL https://en.everybodywiki.com/robots.txt
Domain IPs 104.26.14.17, 104.26.15.17, 172.67.72.55, 2606:4700:20::681a:e11, 2606:4700:20::681a:f11, 2606:4700:20::ac43:4837
Response IP 104.26.15.17
Found Yes
Hash f083f992f12914605190f8a938c8cee0fc8c5339ec3e2106b841a645b8f22eb3
SimHash 209a16b0cd9f

Groups

ahrefsbot

Rule Path
Allow /

mj12bot

Rule Path
Allow /

dotbot

Rule Path
Allow /

seokicks-robot

Rule Path
Allow /

sistrixcrawler

Rule Path
Allow /

semrushbot

Rule Path
Allow /

semrushbot-ba

Rule Path
Allow /

se ranking

Rule Path
Allow /

ubersuggestbot

Rule Path
Allow /

grokbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

gptbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

qwenbot

Rule Path
Disallow /

deepseekbot

Rule Path
Disallow /

wget

Rule Path
Disallow /

wget

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

xenu

Rule Path
Disallow /

*

Rule Path
Disallow /*.JPG
Disallow /*.gif
Disallow /*.jpeg
Disallow /*.jpg
Disallow /*.js?
Disallow /*.png
Disallow /*.svg
Disallow /*.webp?
Disallow /*/1000
Disallow /*/edithistory$
Disallow /*?action=
Disallow /*?action=edit
Disallow /*?fbclid=
Disallow /*?utm_source=
Disallow /*?veaction=
Disallow /*?venotify=
Disallow /*PG99.Asia*
Disallow /*Pg99.Asia*
Disallow /*To66.Asia*
Disallow /*casino*
Disallow /*gamble*
Disallow /*mafabet.io*
Disallow /*mf2u.co*
Disallow /*pg99.Asia*
Disallow /*pg99.asia*
Disallow /*qqline88th.com*
Disallow /*rai88.me*
Disallow /*tips2.co*
Disallow /*to66.Asia*
Disallow /*win66.asia*
Disallow /.well-known/
Disallow /?useskin=
Disallow /Ads.txt
Disallow /Anexo%3A
Disallow /Apple-app-site-association
Disallow /Attribut%3A
Disallow /Cat*gorie%3A
Disallow /Categoria%3A
Disallow /Categorie/
Disallow /Categorie%3A
Disallow /Category%3A
Disallow /Datei%3A
Disallow /Discusi%C3%83%C2%B3n%3A
Disallow /Discussion%3A
Disallow /Discussion_
Disallow /Discussion_utilisateur%3A
Disallow /Edithistory%3A
Disallow /EdithistoryTemplate%3A
Disallow /Especial%3A
Disallow /Ficheiro%3A
Disallow /Fichier%3A
Disallow /Fil%3A
Disallow /File%3A
Disallow /Fitxer%3A
Disallow /Form%3A
Disallow /Formulaire%3A
Disallow /F%C3%83%C2%A1jl%3A
Disallow /Istimewa
Disallow /Kategori%3A
Disallow /Kategoria%3A
Disallow /Kategorie%3A
Disallow /Kateg%C3%83%C2%B3ria%3A
Disallow /Kept_on_Wikipedia%3A
Disallow /MediaWiki
Disallow /MediaWiki%3A
Disallow /Mediawiki%3A
Disallow /Mod*le%3A
Disallow /Modul%3A
Disallow /Module%3A
Disallow /Modulo%3A
Disallow /M%C3%83%C2%B3dulo%3A
Disallow /Plantilla%3A
Disallow /Plik%3A
Disallow /Portale%3A
Disallow /Predefini%C3%83%C2%A7%C3%83%C2%A3o%3A
Disallow /Projet%3A
Disallow /Search/
Disallow /Sp%C3%A9cial%3A*
Disallow /Sp*cial%3A
Disallow /Speci%C3%A1ln%C3%AD%3A
Disallow /Speciaal%3A
Disallow /Special%3A
Disallow /Special%3A*
Disallow /Speciale%3A
Disallow /Speciel%3A
Disallow /Speci%C3%83%C2%A1lis%3A
Disallow /Specjalna%3A
Disallow /Spesial%3A
Disallow /Spezial%3A
Disallow /Sp%C3%83%C2%A9cial%3A
Disallow /Sujet%3A
Disallow /Tags/
Disallow /Talk%3A
Disallow /Template%3A
Disallow /Toiminnot%3A
Disallow /User%3A
Disallow /User_talk%3A
Disallow /Utilisateur%3A
Disallow /Utilizator%3A
Disallow /Vorlage%3A
Disallow /Widget%3A
Disallow /Wikiasite%3A*
Disallow /api.php
Disallow /apple-app-site-association
Disallow /betso88
Disallow /cdn-cgi/
Disallow /extensions
Disallow /images
Disallow /images/
Disallow /index.php
Disallow /index.php/Speciaal%3A
Disallow /load.php
Disallow /osm-intl/
Disallow /resources/
Disallow /search/
Disallow /skins
Disallow /skins/
Disallow /tags/
Disallow /v4/marker/
Disallow /w/api.php
Disallow /%C3%90%C2%A4%C3%90%C2%B0%C3%90%C2%B9%C3%90%C2%BB%3A
Disallow /%C3%90%C2%A8%C3%90%C2%B0%C3%90%C2%B1%C3%90%C2%BB%C3%90%C2%BE%C3%90%C2%BD%3A
Disallow /%C3%98%C2%AE%C3%98%C2%A7%C3%98%C2%B5%3A
Disallow /%C3%98%C2%B4%C3%98%C2%B1%C3%9A%C2%A9%C3%98%C2%AA%3A

Comments

  • Autorise seulement les bots marketing / SEO
  • Bloque tous les autres bots, y compris les bots IA et scrapers non désirés

Warnings

  • 23 invalid lines.