studentpu.podomorouniversity.ac.id
robots.txt

Robots Exclusion Standard data for studentpu.podomorouniversity.ac.id

Resource Scan

Scan Details

Site Domain studentpu.podomorouniversity.ac.id
Base Domain podomorouniversity.ac.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan6/23/2025, 11:40:20 PM
Next Scan 9/21/2025, 11:40:20 PM

Last Successful Scan

Scanned2/1/2025, 11:38:40 PM
URL https://studentpu.podomorouniversity.ac.id/robots.txt
Domain IPs 104.21.65.34, 172.67.188.191, 2606:4700:3030::6815:4122, 2606:4700:3034::ac43:bcbf
Response IP 104.21.65.34
Found Yes
Hash effa6405caf7986a5d4f5ec9fe89a97b68ad10c1ff175dbae3c748ee55ace6f1
SimHash 10152862f5b4

Groups

*

Rule Path
Disallow /uploads/jgcor/
Disallow /upload/jgcor/
Disallow /uploads/xgcor/
Disallow /upload/xgcor/
Disallow /file/
Disallow /xgcor/
Disallow /jgcor/
Disallow /togel/
Disallow /ibu4d/
Disallow /assets/
Disallow /upload/
Disallow /uploads/
Disallow /document/
Disallow /images/
Disallow /application/
Disallow /js/
Disallow /upload/api
Disallow /document/api
Disallow /game/
Disallow /casino/
Disallow /slot/
Disallow /sportsbook/
Disallow /4d/
Disallow /prediksi/
Disallow /angka-jitu/
Disallow /bet/
Disallow /betting/
Disallow /jackpot/
Disallow /lottery/
Disallow /baccarat/
Disallow /poker/
Disallow /bonus/
Allow /images/logo.png
Disallow /robots.txt

googlebot
ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

Comments

  • Blokir direktori yang sering disalahgunakan
  • Blokir pola tambahan yang sering diserang
  • Izin hanya untuk file atau direktori tertentu (opsional)
  • Prevent indexing of robots.txt itself
  • Prevent Googlebot from displaying cached versions
  • Blokir bot khusus (opsional, berdasarkan User-agent)

Warnings

  • `noarchive` is not a known field.