app.myhr.works
robots.txt

Robots Exclusion Standard data for app.myhr.works

Resource Scan

Scan Details

Site Domain app.myhr.works
Base Domain myhr.works
Scan Status Ok
Last Scan2026-01-20T21:44:01+00:00
Next Scan 2026-02-19T21:44:01+00:00

Last Scan

Scanned2026-01-20T21:44:01+00:00
URL https://app.myhr.works/robots.txt
Domain IPs 172.66.40.174, 172.66.43.82, 2606:4700:3108::ac42:28ae, 2606:4700:3108::ac42:2b52
Response IP 172.66.43.82
Found Yes
Hash b44757592115a2be8f3e2a79fb18a71a836a00c7b6bfadb096f82cee21b2b229
SimHash bc1d8312d4f1

Groups

*

Rule Path
Disallow /
Allow /login

Comments

  • The robots.txt file is used to control how search engines index your live URLs.
  • See http://www.robotstxt.org/wc/norobots.html for more information.
  • We prevent search engines from seeing the site except for the /login page:
  • Because files here are served under /static-member-forms we also need a
  • rewrite rule in nginx so that /robots.txt serves this file for app