techtatva.manipal.edu
robots.txt

Robots Exclusion Standard data for techtatva.manipal.edu

Resource Scan

Scan Details

Site Domain techtatva.manipal.edu
Base Domain manipal.edu
Scan Status Ok
Last Scan2025-11-28T07:05:25+00:00
Next Scan 2025-12-28T07:05:25+00:00

Last Scan

Scanned2025-11-28T07:05:25+00:00
URL https://techtatva.manipal.edu/robots.txt
Domain IPs 54.83.101.244
Response IP 54.83.101.244
Found Yes
Hash dded9fbcfaf430ffc38bad8848662f14a86a50997f329061853634e4c9f46614
SimHash 6b0858f347a1

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /adminlogs/
Disallow /api/
Disallow /_next/
Disallow /static/
Allow /
Allow /events
Allow /passes
Allow /combos
Allow /contact
Allow /team
Allow /timetable
Allow /conclave

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://techtatva.manipal.edu/sitemap.xml

Comments

  • Sitemap
  • Crawl-delay
  • Disallow admin and private areas
  • Allow important pages