geminigen.ai
robots.txt
Robots Exclusion Standard data for geminigen.ai
Resource Scan
Scan Details
| Site Domain | geminigen.ai |
| Base Domain | geminigen.ai |
| Scan Status | Ok |
| Last Scan | 2025-11-15T06:40:46+00:00 |
| Next Scan | 2025-12-15T06:40:46+00:00 |
Last Scan
| Scanned | 2025-11-15T06:40:46+00:00 |
| URL | https://geminigen.ai/robots.txt |
| Domain IPs | 104.26.8.68, 104.26.9.68, 172.67.73.7, 2606:4700:20::681a:844, 2606:4700:20::681a:944, 2606:4700:20::ac43:4907 |
| Response IP | 104.26.8.68 |
| Found | Yes |
| Hash | a06b85d5b1c1e6368e2aca51d232804182ee65ac16579519b30d210d98bc3493 |
| SimHash | 443549538454 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /app |
| Allow | /app/video-gen |
| Allow | /app/speech-gen |
| Allow | /app/dialogue-gen |
| Allow | /pricing |
| Allow | /api-docs |
| Allow | /terms |
| Allow | /privacy |
| Disallow | /profile |
| Disallow | /history |
| Disallow | /auth/ |
| Disallow | /orders |
| Disallow | /admin |
| Disallow | /_nuxt/ |
| Disallow | /api/ |
| Allow | /auth/login |
| Allow | /auth/signup |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://geminigen.ai/sitemap-index.xml |
| sitemap | https://geminigen.ai/sitemap.xml |
| sitemap | https://geminigen.ai/sitemap-docs.xml |
| sitemap | https://geminigen.ai/sitemap-blog.xml |
Warnings
- `content-signal` is not a known field.
Comments