bimbel.viracun.id
robots.txt

Robots Exclusion Standard data for bimbel.viracun.id

Resource Scan

Scan Details

Site Domain bimbel.viracun.id
Base Domain viracun.id
Scan Status Ok
Last Scan2025-09-29T08:11:49+00:00
Next Scan 2025-10-29T08:11:49+00:00

Last Scan

Scanned2025-09-29T08:11:49+00:00
URL https://bimbel.viracun.id/robots.txt
Domain IPs 104.26.8.137, 104.26.9.137, 172.67.74.75, 2606:4700:20::681a:889, 2606:4700:20::681a:989, 2606:4700:20::ac43:4a4b
Response IP 104.26.9.137
Found Yes
Hash 32197d6a6365b5568875d510c86bb36572b07fe954984e2930ba2c6f82154e78
SimHash 604e0ff2ecb4

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /private/
Disallow /*.json$
Disallow /*?*utm_*
Disallow /*?*ref=*
Disallow /*?*fbclid=*
Allow /assets/
Allow /public/
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.jpeg
Allow /*.gif
Allow /*.svg
Allow /*.webp

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://viracun.id/sitemap.xml

Comments

  • Sitemap
  • Crawl-delay for responsible crawling
  • Block access to unnecessary paths
  • Allow important assets