app.sprinto.com
robots.txt

Robots Exclusion Standard data for app.sprinto.com

Resource Scan

Scan Details

Site Domain app.sprinto.com
Base Domain sprinto.com
Scan Status Ok
Last Scan2025-05-02T20:40:14+00:00
Next Scan 2025-06-01T20:40:14+00:00

Last Scan

Scanned2025-05-02T20:40:14+00:00
URL https://app.sprinto.com/robots.txt
Domain IPs 3.165.75.37, 3.165.75.61, 3.165.75.77, 3.165.75.98
Response IP 3.165.75.61
Found Yes
Hash e3be81167c42f4acf1ef72b7b1a50dd0268c9a5acd0e2c7f2612dbaac54355be
SimHash b0d2810ac760

Groups

*

Rule Path Comment
Allow /$ Allow only the root domain (homepage or Trust Center root)
Disallow / -

Comments

  • This file tells search engine bots what they can and cannot crawl.
  • Since our application is mostly behind authentication, we restrict indexing for almost all the pages
  • Custom Domains & Trust Center:
  • - When a customer configures a custom domain, it serves the Trust Center at the root (`/`).
  • - Trust Center subpages (`/compliance, /resources`) are dynamic and change per user configuration .
  • - To prevent indexing of these subpages, we disallow everything except `/`.
  • Block everything else, including dynamically generated subpages