metal-observer.com
robots.txt

Robots Exclusion Standard data for metal-observer.com

Resource Scan

Scan Details

Site Domain metal-observer.com
Base Domain metal-observer.com
Scan Status Ok
Last Scan2026-03-16T09:11:10+00:00
Next Scan 2026-04-15T09:11:10+00:00

Last Scan

Scanned2026-03-16T09:11:10+00:00
URL https://metal-observer.com/robots.txt
Domain IPs 35.213.161.57
Response IP 35.213.161.57
Found Yes
Hash 3ec7726f71e9d12dedc141b714952dcc586d7630c53aae001936a6e8e3df9896
SimHash 2a57d2704190

Groups

mediapartners-google

Rule Path
Disallow

googlebot

Rule Path
Allow /
Disallow /search

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://metal-observer.com/sitemap.xml

Comments

  • Mengizinkan Google AdSense untuk merayapi semua konten
  • Mengatur Googlebot (crawler Google utama)
  • Mengizinkan akses ke seluruh situs
  • Melarang crawling halaman search
  • Mengatur semua crawler lainnya
  • Lokasi sitemap