Log In Sign Up

ymob.com.br
robots.txt

Robots Exclusion Standard data for ymob.com.br

Resource Scan

Scan Details

Site Domain ymob.com.br
Base Domain ymob.com.br
Scan Status Ok
Last Scan2025-05-28T11:13:43+00:00
Next Scan 2025-06-27T11:13:43+00:00

Last Scan

Scanned2025-05-28T11:13:43+00:00
URL https://ymob.com.br/robots.txt
Domain IPs 104.21.23.131, 172.67.211.74, 2606:4700:3031::6815:1783, 2606:4700:3031::ac43:d34a
Response IP 172.67.211.74
Found Yes
Hash d312d14f8de95dde7e8455a85028440ee5d1b775cec195dd315e133943ab7ad2
SimHash 291fde61c6d0

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

semrushbot

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

slurp

Rule Path
Allow /

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://ymob.com.br/sitemap.xml
Back to top

Comments

  • Google e Bing
  • Bots de anúncios e análise do Google
  • Bots de redes sociais
  • Bots de análise e SEO
  • Bloquear todos os outros bots
  • Configurar um crawl delay para reduzir impacto
  • Sitemap
Back to top