members.engineeringnz.org
robots.txt

Robots Exclusion Standard data for members.engineeringnz.org

Resource Scan

Scan Details

Site Domain members.engineeringnz.org
Base Domain engineeringnz.org
Scan Status Ok
Last Scan2024-11-17T15:46:34+00:00
Next Scan 2024-12-01T15:46:34+00:00

Last Scan

Scanned2024-11-17T15:46:34+00:00
URL https://members.engineeringnz.org/robots.txt
Domain IPs 13.228.64.83, 13.228.64.84, 13.228.64.85
Response IP 13.228.64.84
Found Yes
Hash dd981f4248ef73e19e3eb67169e4db5aeb7f8dec6b711dc3d495be417c2ae237
SimHash 23409759c653

Groups

*

Product Comment
* Applies to all robots
Rule Path
Allow /s/*
Allow /s/login?*
Allow /s/login/SelfRegister?*
Disallow /login?*

Other Records

Field Value
sitemap https://members.engineeringnz.org/s/sitemap.xml

Comments

  • Custom robots.txt for Engineering New Zealand Member Community portal.
  • Allow Google Index optimization for Public Community
  • Allow indexing of Login and Registration
  • Disallow indexing of downloadable files