generatepolicy.com
robots.txt
Robots Exclusion Standard data for generatepolicy.com
Resource Scan
Scan Details
| Site Domain | generatepolicy.com |
| Base Domain | generatepolicy.com |
| Scan Status | Ok |
| Last Scan | 2025-11-25T09:57:37+00:00 |
| Next Scan | 2025-12-25T09:57:37+00:00 |
Last Scan
| Scanned | 2025-11-25T09:57:37+00:00 |
| URL | https://generatepolicy.com/robots.txt |
| Domain IPs | 104.21.66.194, 172.67.163.234, 2606:4700:3035::ac43:a3ea, 2606:4700:3036::6815:42c2 |
| Response IP | 172.67.163.234 |
| Found | Yes |
| Hash | 537b373142ae2d07e5bda7a6962482ea049f46a7716ee3bb1c2a87ac5e1babca |
| SimHash | 493462b24653 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /policies |
| Allow | /policies/* |
| Allow | /auth |
| Allow | /tokenomics |
| Allow | /compliance |
| Disallow | /questionnaires |
| Disallow | /checklists |
| Disallow | /dashboard |
| Disallow | /generated-policies |
| Disallow | /token-history |
Other Records
| Field | Value |
|---|---|
| sitemap | https://generatepolicy.com/sitemap.xml |