Log In Sign Up

psb.feb.ui.ac.id
robots.txt

Robots Exclusion Standard data for psb.feb.ui.ac.id

Resource Scan

Scan Details

Site Domain psb.feb.ui.ac.id
Base Domain ui.ac.id
Scan Status Ok
Last Scan2025-10-16T00:53:14+00:00
Next Scan 2025-11-15T00:53:14+00:00

Last Scan

Scanned2025-10-16T00:53:14+00:00
URL https://psb.feb.ui.ac.id/robots.txt
Domain IPs 152.118.148.151
Response IP 152.118.148.151
Found Yes
Hash b157a111b9d0cb87020a42a1fbbe5234a538489204d725566823da8e1f8cb90a
SimHash 60266870e3b8

Groups

*

Rule Path
Allow /
Allow /index.php
Allow /images/
Allow /css/
Allow /js/
Allow /template/
Allow /files/docs/
Allow /files/images/
Disallow /admin/
Disallow /config/
Disallow /lib/
Disallow /vendor/
Disallow /plugins/
Disallow /upgrade/
Disallow /simbio2/
Disallow /indexing_engine/
Disallow /api/
Disallow /src/
Disallow /files/temp/
Disallow /files/cache/
Disallow /files/backup/
Disallow /*.log
Disallow /*.sql
Disallow /*.bak
Disallow /*.txt
Disallow /sysconfig.inc.php
Disallow /composer.json
Disallow /composer.lock
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/
Disallow /phpmyadmin/
Allow /sitemap.xml

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://psb.feb.ui.ac.id/sitemap.xml
sitemap https://psb.feb.ui.ac.id/sitemap/sitemap.xml
Back to top

Comments

  • Robots.txt for SLiMS 9.6.1 Bulian - PSB FEB UI
  • Generated: October 4, 2025
  • Purpose: SEO-safe configuration with security directory blocking
  • Allow main content and search
  • Block sensitive directories for security
  • Block temporary and cache directories
  • Block log files and sensitive files
  • Block common attack vectors
  • Allow sitemap for SEO
  • Crawl-delay to prevent server overload
Back to top