hep.org.au
robots.txt

Robots Exclusion Standard data for hep.org.au

Resource Scan

Scan Details

Site Domain hep.org.au
Base Domain hep.org.au
Scan Status Ok
Last Scan2025-10-21T02:37:05+00:00
Next Scan 2025-11-20T02:37:05+00:00

Last Scan

Scanned2025-10-21T02:37:05+00:00
URL https://hep.org.au/robots.txt
Redirect https://www.hep.org.au/robots.txt
Redirect Domain www.hep.org.au
Redirect Base hep.org.au
Domain IPs 104.21.81.188, 172.67.190.73, 2606:4700:3031::6815:51bc, 2606:4700:3033::ac43:be49
Redirect IPs 104.21.81.188, 172.67.190.73, 2606:4700:3031::6815:51bc, 2606:4700:3033::ac43:be49
Response IP 172.67.190.73
Found Yes
Hash 5e6f763e446a79323d334cecc86d212683b462e240f9ad48c88e310f683034a8
SimHash 4119cc406695

Groups

*

Rule Path
Allow /*.css
Allow /*.js
Disallow /calendar/action*
Disallow /events/action*
Disallow /cdn-cgi*
Disallow /*?

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.hep.org.au/sitemap_index.xml

Comments

  • Hep Robots.txt