edunitas.com
robots.txt

Robots Exclusion Standard data for edunitas.com

Resource Scan

Scan Details

Site Domain edunitas.com
Base Domain edunitas.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-03T15:20:51+00:00
Next Scan 2025-12-02T15:20:51+00:00

Last Successful Scan

Scanned2024-10-16T14:48:59+00:00
URL https://edunitas.com/robots.txt
Domain IPs 172.66.41.10, 172.66.42.246, 2606:4700:3108::ac42:290a, 2606:4700:3108::ac42:2af6
Response IP 172.66.41.10
Found Yes
Hash 34b41975d39fab62fe131233158642376262708f7690f348d3bd89cc9f34489d
SimHash aa5453b3cd51

Groups

facebookexternalhit

Rule Path
Allow /

*

Rule Path
Disallow /logout
Disallow */me
Disallow /transaction
Disallow /wishlist
Disallow /inbox
Disallow /profile
Disallow /z-bengkel
Disallow /edudonation?
Disallow /educampus/detail/STT-Pekanbaru?
Disallow */test
Disallow /home/dev
Disallow /test/detail
Disallow /daftar/educampustest
Disallow /eduadvertising
Disallow /edunews/detail_scrap
Disallow /educampus/detail_scrap
Disallow /educampus/quisioner_tempat_kerja
Disallow /educampus/tambah_mahasiswa
Disallow /educampus/sistem_seleksi
Disallow /educampus/keunggulan
Disallow /educampus/tujuan
Disallow /educampus/solusi_cerdas
Disallow /educampus/waktu_kuliah_dan_dosen
Disallow /educampus/beban_dan_masa_studi
Disallow /educampus/status_dan_sistem_pendidikan
Disallow /educampus/penerimaan_mahasiswa
Disallow /educampus/daftar_website
Disallow /beasiswakuliahgratis
Disallow /beasiswalist
Disallow /formulirlist
Disallow /formulirdownload

Other Records

Field Value
sitemap https://edunitas.com/sitemap_index.xml

Comments

  • edunitas.com robots.txt -- just crawl it.
  • Disallow: /kuliah
  • Sementara Disallow
  • Disallow: /sekolah
  • Disallow: /edudonation/no-script.html