Log In Sign Up

unidatech.ac.id
robots.txt

Robots Exclusion Standard data for unidatech.ac.id

Resource Scan

Scan Details

Site Domain unidatech.ac.id
Base Domain unidatech.ac.id
Scan Status Ok
Last Scan2026-03-20T22:56:42+00:00
Next Scan 2026-04-19T22:56:42+00:00

Last Scan

Scanned2026-03-20T22:56:42+00:00
URL https://unidatech.ac.id/robots.txt
Domain IPs 104.21.71.86, 172.67.170.73, 2606:4700:3031::ac43:aa49, 2606:4700:3035::6815:4756
Response IP 104.21.71.86
Found Yes
Hash ce21ad8797e1f0bb29524970045a4bee059f804b93f3bf62bff6e19b68dbb34c
SimHash 49017eb4bd11

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Allow /blog/
Allow /tentang
Allow /kontak
Allow /login
Allow /register
Allow /privacy
Allow /tos

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://unidatech.ac.id/sitemap.xml
Back to top

Comments

  • robots.txt for https://unidatech.ac.id
  • Sitemap
  • Crawl-delay
  • Disallow admin and API paths (if any in future)
  • Allow all public content
Back to top