Log In Sign Up

casinovios.com
robots.txt

Robots Exclusion Standard data for casinovios.com

Resource Scan

Scan Details

Site Domain casinovios.com
Base Domain casinovios.com
Scan Status Ok
Last Scan2026-02-11T16:47:44+00:00
Next Scan 2026-02-18T16:47:44+00:00

Last Scan

Scanned2026-02-11T16:47:44+00:00
URL https://casinovios.com/robots.txt
Domain IPs 104.21.41.10, 172.67.158.214, 2606:4700:3031::6815:290a, 2606:4700:3035::ac43:9ed6
Response IP 104.21.41.10
Found Yes
Hash 44d5d2cca108f2a0ca3a5853103f4907b856809548766ed359275977cd5ad8d3
SimHash f95468408432

Groups

criteobot/0.1

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

e-societyrobot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

zao

Rule Path
Disallow /

webzip

Rule Path
Disallow /

teleport

Rule Path
Disallow /

exabot

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

linko

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

speedy

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

httrack

Rule Path
Disallow /

yandex

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

xenu

Rule Path
Disallow /

bloglines/3.1

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

larbin

Rule Path
Disallow /

wget

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

libwww

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

jyxobot/1

Rule Path
Disallow /

fetch

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

npbot

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

slurp

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

doc

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

aboundex

Rule Path
Disallow /

admantx

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

discobot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

gigablast

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

lipperhey

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

niki-bot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

orangebot

Rule Path
Disallow /

panscient

Rule Path
Disallow /

phpcrawl

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

spbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

wesee

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /admin/
Disallow /src/
Disallow /vendor/
Disallow /config/
Disallow /logs/
Disallow /tmp/
Disallow /cache/
Disallow /private/
Disallow /perfil/
Disallow /mis-anuncios/
Disallow /logout.php
Disallow /auth/
Disallow /login
Disallow /register
Disallow /buscar?*
Disallow /?*q=*
Disallow /search
Allow /segunda-mano/*?page=*
Allow /autos-de-segunda-mano/*?page=*
Allow /motos-de-segunda-mano/*?page=*
Allow /furgonetas-de-segunda-mano/*?page=*
Allow /coches-de-segunda-mano/*?page=*
Allow /contacto
Allow /sobre-nosotros
Allow /terminos-y-condiciones
Allow /privacidad
Allow /cookies
Allow /faq
Allow /ayuda
Allow /rules
Allow /safety
Allow /guia-comprar-segunda-mano
Allow /guia-vender-segunda-mano
Allow /consejos-seguridad
Allow /
Allow /categorias
Allow /poner-anuncios-gratis/

chatgpt-user

Rule Path
Allow /

claude-web

Rule Path
Allow /

google-extended

Rule Path
Allow /

bard

Rule Path
Allow /

gptbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

metaai

Rule Path
Allow /

bingbot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

applebot

Rule Path
Disallow /buscar?*
Disallow /search

Other Records

Field Value
crawl-delay 10

bytespider

Rule Path
Disallow /buscar?*
Disallow /search

Other Records

Field Value
crawl-delay 20
Back to top

Other Records

Field Value
sitemap https://www.casinuevo.com/sitemap-www.casinuevo.com.xml
sitemap https://www.casinovios.com/sitemap-www-casinovios-com.xml
Back to top

Comments

  • Bloquear bots maliciosos y scrapers
  • Reglas generales para todos los bots legítimos
  • Bloquear áreas administrativas y privadas
  • Bloquear páginas de usuario y autenticación
  • Bloquear parámetros de búsqueda y filtros (permitir rastreo limpio)
  • PERMITIR PAGINACIÓN EN CATEGORÍAS (Para SEO)
  • Permitir páginas de autoridad y confianza (E-E-A-T)
  • Permitir otras páginas estructurales
  • Permitir específicamente bots de IA beneficiosos
  • Crawl delay solo para bots que lo soportan
  • Sitemaps
Back to top

Warnings

  • 2 invalid lines.
Back to top