Log In Sign Up

efst.unist.hr
robots.txt

Robots Exclusion Standard data for efst.unist.hr

Resource Scan

Scan Details

Site Domain efst.unist.hr
Base Domain unist.hr
Scan Status Ok
Last Scan2025-08-03T06:59:51+00:00
Next Scan 2025-09-02T06:59:51+00:00

Last Scan

Scanned2025-08-03T06:59:51+00:00
URL https://efst.unist.hr/robots.txt
Domain IPs 193.198.36.9
Response IP 193.198.36.9
Found Yes
Hash 555951fff0378ad677d104c395c777854a052c13d7e6c6e4598de801c4addcc6
SimHash f31d155dee86

Groups

*

Rule Path
Disallow
Disallow /admin/
Disallow /App_Browsers/
Disallow /App_Code/
Disallow /App_Data/
Disallow /App_GlobalResources/
Disallow /bin/
Disallow /Components/
Disallow /Config/
Disallow /contest/
Disallow /controls/
Disallow /DesktopModules/
Disallow /Documentation/
Disallow /HttpModules/
Disallow /images/
Disallow /Install/
Disallow /js/
Disallow /Providers/
Disallow /Resources/ContentRotator/
Disallow /Resources/ControlPanel/
Disallow /Resources/Dashboard/
Disallow /Resources/Search/
Disallow /Resources/Shared/
Disallow /Resources/SkinWidgets/
Disallow /Resources/Widgets/
Disallow /Activity-Feed/userId/

anthropic-ai

Rule Path
Disallow /
Disallow /

claudebot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /
Back to top

Comments

  • Begin robots.txt file
  • /-----------------------------------------------\
  • | In single portal/domain situations, uncomment the sitmap line and enter domain name
  • \-----------------------------------------------/
  • Sitemap: http://www.DomainNamehere.com/sitemap.aspx
  • End of robots.txt file
Back to top

Warnings

  • `‍user-agent` is not a known field.
Back to top