sapitoto.id
robots.txt

Robots Exclusion Standard data for sapitoto.id

Resource Scan

Scan Details

Site Domain sapitoto.id
Base Domain sapitoto.id
Scan Status Ok
Last Scan2025-10-29T09:48:44+00:00
Next Scan 2025-11-28T09:48:44+00:00

Last Scan

Scanned2025-10-29T09:48:44+00:00
URL https://sapitoto.id/robots.txt
Domain IPs 104.21.37.46, 172.67.203.243, 2606:4700:3036::ac43:cbf3, 2606:4700:3037::6815:252e
Response IP 172.67.203.243
Found Yes
Hash a861279e0fd41f8b52ca7f68414c3f64c7ec7347be340b4deb3e38a5d93a78db
SimHash 6c05cce6437f

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

lumendatabase

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://sapitoto.id/sitemap.xml

Comments

  • Izinkan Googlebot
  • Izinkan Googlebot Image
  • Izinkan Googlebot Mobile
  • Blokir Lumendatabase
  • Aturan umum untuk semua bot
  • Sitemap utama