Log In Sign Up

gemapp.io
robots.txt

Robots Exclusion Standard data for gemapp.io

Resource Scan

Scan Details

Site Domain gemapp.io
Base Domain gemapp.io
Scan Status Ok
Last Scan2025-08-12T19:49:52+00:00
Next Scan 2025-08-26T19:49:52+00:00

Last Scan

Scanned2025-08-12T19:49:52+00:00
URL https://gemapp.io/robots.txt
Domain IPs 104.21.92.93, 172.67.190.225, 2606:4700:3032::6815:5c5d, 2606:4700:3036::ac43:bee1
Response IP 104.21.92.93
Found Yes
Hash e6ca3c0cfdcc529a17daa53b73f68b12c6ba78fda83e8d0094b6c82026394b97
SimHash 0510ae436ff1

Groups

perplexitybot

Rule Path
Allow /

perplexity-user

Rule Path
Allow /

mozilla/5.0 applewebkit/537.36 (khtml, like gecko; compatible; perplexitybot/1.0; +https://perplexity.ai/perplexitybot)

Rule Path
Allow /

mozilla/5.0 applewebkit/537.36 (khtml, like gecko; compatible; perplexity-user/1.0; +https://perplexity.ai/perplexity-user)

Rule Path
Allow /

*

Rule Path
Allow /
Back to top

Comments

  • Allow PerplexityBot
  • Allow Perplexity-User
  • Allow PerplexityBot with full user agent string
  • Allow Perplexity-User with full user agent string
  • Default rule for all other crawlers
Back to top