new-ui.com
robots.txt
Robots Exclusion Standard data for new-ui.com
Resource Scan
Scan Details
| Site Domain | new-ui.com |
| Base Domain | new-ui.com |
| Scan Status | Ok |
| Last Scan | 2025-09-14T07:49:17+00:00 |
| Next Scan | 2025-10-14T07:49:17+00:00 |
Last Scan
| Scanned | 2025-09-14T07:49:17+00:00 |
| URL | https://new-ui.com/robots.txt |
| Domain IPs | 104.21.17.106, 172.67.175.120, 2606:4700:3031::6815:116a, 2606:4700:3034::ac43:af78 |
| Response IP | 104.21.17.106 |
| Found | Yes |
| Hash | 000996c0f7996a1dc3a8e42424af671e2b1ce71fe45e94727e42255c243b01f7 |
| SimHash | a30cd211da32 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /templates |
| Allow | /templates/coming-soon |
| Allow | /templates/directory |
| Allow | /templates/job-listing |
| Allow | /templates/journal |
| Allow | /docs/about/overview |
| Allow | /docs/about/accessibility |
| Allow | /docs/getting-started/installation |
| Allow | /docs/foundations/colors |
| Allow | /docs/foundations/effects |
| Allow | /docs/foundations/spacings |
| Allow | /docs/foundations/typography |
| Allow | /docs/foundations/reset |
| Allow | /docs/theming/configuration |
| Allow | /docs/templates/coming-soon |
| Allow | /docs/templates/directory |
| Allow | /docs/templates/job-listing |
| Allow | /docs/templates/journal |
| Disallow | /admin/ |
| Disallow | /dev/ |
| Disallow | /internal/ |
| Disallow | /playground/ |
| Disallow | /api/ |
| Disallow | /private/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://new-ui.com/sitemap.txt |
Comments