lemitti.com
robots.txt

Robots Exclusion Standard data for lemitti.com

Resource Scan

Scan Details

Site Domain lemitti.com
Base Domain lemitti.com
Scan Status Ok
Last Scan2025-11-08T15:46:32+00:00
Next Scan 2025-12-08T15:46:32+00:00

Last Scan

Scanned2025-11-08T15:46:32+00:00
URL https://lemitti.com/robots.txt
Domain IPs 104.20.27.166, 172.66.147.119, 2606:4700:10::6814:1ba6, 2606:4700:10::ac42:9377
Response IP 172.66.147.119
Found Yes
Hash 360f6f4cff3d9bf9910a80b06a0c877e8c4eb62e2c24f493debb346135045dc0
SimHash 2809df81d564

Groups

googlebot
siteauditbot

Rule Path
Allow /

semrushbot-si

Rule Path
Allow /

semrushbot

Rule Path
Allow /

semrushbot-desktop

Rule Path
Allow /

semrushbot-mobile

Rule Path
Allow /

semrushbot-ba

Rule Path
Allow /

semrushbot-swa

Rule Path
Allow /

splitsignalbot

Rule Path
Allow /

semrushbot-ocob

Rule Path
Allow /

semrushbot-ft

Rule Path
Allow /

rytebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

msnbot

Rule Path
Allow /

slurp

Rule Path
Allow /

yahoo-mmcrawler

Rule Path
Allow /

yahoo-blogs

Rule Path
Allow /
Disallow /auth

ia_archiver

Rule Path
Disallow /auth

msnbot-media

Rule Path
Disallow /auth

*

Rule Path
Disallow /

Comments

  • Permitir Googlebot (Google Search)
  • Semrush
  • Permitir Googlebot-Image (Google Image)
  • Permitir Googlebot-Mobile (Google Mobile)
  • Permitir MSNBot (MSN Search)
  • Permitir Yahoo! Slurp (Yahoo Search)
  • Permitir Yahoo-MMCrawler (Yahoo MM)
  • Permitir Yahoo-Blogs (Yahoo Blogs)
  • Permitir Alexa/Wayback Machine
  • Permitir MSN PicSearch
  • Bloquear todos os outros bots