leminerale.org
robots.txt

Robots Exclusion Standard data for leminerale.org

Resource Scan

Scan Details

Site Domain leminerale.org
Base Domain leminerale.org
Scan Status Ok
Last Scan2026-02-13T09:58:05+00:00
Next Scan 2026-03-15T09:58:05+00:00

Last Scan

Scanned2026-02-13T09:58:05+00:00
URL https://leminerale.org/robots.txt
Domain IPs 104.21.48.109, 172.67.184.45, 2606:4700:3033::6815:306d, 2606:4700:3037::ac43:b82d
Response IP 172.67.184.45
Found Yes
Hash 5229a7d26e106451ce2b84bd752b8b2a27ed5a2587b1a86069049a5a9c7fcc55
SimHash 6c058eeb5d73

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

lumendatabase

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.leminerale.org/sitemap.xml

Comments

  • Izinkan Googlebot
  • Izinkan Googlebot Image
  • Izinkan Googlebot Mobile
  • Blokir Lumendatabase
  • Aturan umum untuk semua bot
  • Sitemap utama