Log In Sign Up

frasescortasde.com
robots.txt

Robots Exclusion Standard data for frasescortasde.com

Resource Scan

Scan Details

Site Domain frasescortasde.com
Base Domain frasescortasde.com
Scan Status Ok
Last Scan2026-01-01T07:20:24+00:00
Next Scan 2026-01-08T07:20:24+00:00

Last Scan

Scanned2026-01-01T07:20:24+00:00
URL https://frasescortasde.com/robots.txt
Domain IPs 104.21.13.90, 172.67.155.115, 2606:4700:3036::ac43:9b73, 2606:4700:3037::6815:d5a
Response IP 172.67.155.115
Found Yes
Hash b2b707309c5bedbdf0fc59fd89a2b6c7233e40a82757faf39535861ecc16398e
SimHash 085c4e50f6eb

Groups

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

slurp

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

*

Rule Path Comment
Disallow /wp-admin/ -
Disallow /cgi-bin/ -
Disallow /tmp/ -
Disallow /private/ -
Disallow /admin/ -
Disallow /login/ -
Disallow /*?* Evita URLs con parámetros
Back to top

Other Records

Field Value
sitemap https://frasescortasde.com/sitemap.xml
sitemap https://frasescortasde.com/rss.xml
Back to top

Comments

  • ----------------------------------------
  • Robots.txt optimizado
  • ----------------------------------------
  • Permitir bots principales
  • Bloquear bots molestos/no deseados
  • ----------------------------------------
  • Sitemap y RSS
  • ----------------------------------------
  • Opcional: velocidad de rastreo (si tu hosting es limitado)
  • Crawl-delay: 10
Back to top