fn.mahacet.org
robots.txt

Robots Exclusion Standard data for fn.mahacet.org

Resource Scan

Scan Details

Site Domain fn.mahacet.org
Base Domain mahacet.org
Scan Status Ok
Last Scan2025-10-16T05:41:28+00:00
Next Scan 2025-11-15T05:41:28+00:00

Last Scan

Scanned2025-10-16T05:41:28+00:00
URL https://fn.mahacet.org/robots.txt
Domain IPs 62.72.43.163
Response IP 62.72.43.163
Found Yes
Hash f186ffda09db2a19367dff1992bc56ea4d66a0c72bd06bcf7cc02965b2a8b6aa
SimHash 2b2a5d50ee21

Groups

*

Rule Path
Allow /
Allow /index.php
Allow /contact.php
Allow /coursedetail.php
Allow /policy.php
Allow /cappolicy.php
Allow /CopyrightPolicy.php
Allow /security-policy.php
Allow /contingency-plan.php
Allow /monitoring-plan.php
Allow /crp-policy.php
Allow /broken-links.php
Allow /frmCMAP.php
Allow /allrightsreserved_9f3b2c.php
Allow /public/static/
Allow /public/static/Images/
Allow /public/static/Styles/
Allow /public/static/Scripts/
Allow /public/static/App_Themes/
Disallow /includes/
Disallow /config/
Disallow /api/
Disallow /data/
Disallow /test.php
Disallow /counter.php
Disallow /subscribe.php
Disallow /unsubscribe.php
Disallow /admin/
Disallow /admin_sections.php
Disallow /data_handler.php
Disallow /email_handler.php
Disallow /remove_subscriber.php
Disallow /send_newsletter.php
Disallow /.git/
Disallow /.gitignore
Disallow /README.md
Disallow /SETUP.md

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://fn.mahacet.org/sitemap.xml

Comments

  • Main pages
  • Static assets
  • Sensitive areas
  • Admin and form processing
  • System files
  • Sitemap
  • Crawl delay