Log In Sign Up

sultanaweb.com
robots.txt

Robots Exclusion Standard data for sultanaweb.com

Resource Scan

Scan Details

Site Domain sultanaweb.com
Base Domain sultanaweb.com
Scan Status Ok
Last Scan2026-02-10T03:31:31+00:00
Next Scan 2026-02-24T03:31:31+00:00

Last Scan

Scanned2026-02-10T03:31:31+00:00
URL https://sultanaweb.com/robots.txt
Domain IPs 104.21.41.232, 172.67.195.223, 2606:4700:3031::ac43:c3df, 2606:4700:3037::6815:29e8
Response IP 104.21.41.232
Found Yes
Hash 4da2ed0e666ca12d4f8e9e17bca492f0f4c3efc228372b8dc14b8d0f5c230b7f
SimHash e91e0eb64fb3

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /_next/static/chunks/
Disallow /api/
Disallow /.well-known/
Disallow /temp/
Disallow /private/

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

whatsapp

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

majesticseo

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://sultanaweb.com/sitemap.xml
Back to top

Comments

  • Robots.txt para Sultana Web
  • https://sultanaweb.com/robots.txt
  • Permitir acceso a todos los bots principales
  • Bloquear archivos y directorios no públicos
  • Bots específicos de búsqueda
  • Bots de redes sociales
  • Bloquear bots problemáticos
  • Archivos del sitio
  • Información adicional
  • Contacto: contacto@sultanaweb.com
  • Política: /aviso-de-privacidad
Back to top

Warnings

  • `host` is not a known field.
Back to top