app.getgrass.io
robots.txt

Robots Exclusion Standard data for app.getgrass.io

Resource Scan

Scan Details

Site Domain app.getgrass.io
Base Domain getgrass.io
Scan Status Ok
Last Scan2024-11-03T06:58:56+00:00
Next Scan 2024-12-03T06:58:56+00:00

Last Scan

Scanned2024-11-03T06:58:56+00:00
URL https://app.getgrass.io/robots.txt
Domain IPs 108.156.133.107, 108.156.133.56, 108.156.133.65, 108.156.133.8
Response IP 108.156.133.65
Found Yes
Hash fe57f97554d07eade33c4844d039035984e8a96836a7e05198808eae632090e6
SimHash 4842cbc266b2

Groups

*

Rule Path
Allow /
Allow /register?referralCode=*

*

Rule Path
Disallow /api/*

Comments

  • Allow crawler access
  • Block all crawlers for all /api/*