index.dev
robots.txt
Robots Exclusion Standard data for index.dev
Resource Scan
Scan Details
| Site Domain | index.dev |
| Base Domain | index.dev |
| Scan Status | Ok |
| Last Scan | 2026-02-07T13:36:06+00:00 |
| Next Scan | 2026-03-09T13:36:06+00:00 |
Last Scan
| Scanned | 2026-02-07T13:36:06+00:00 |
| URL | https://index.dev/robots.txt |
| Redirect | https://www.index.dev/robots.txt |
| Redirect Domain | www.index.dev |
| Redirect Base | index.dev |
| Domain IPs | 104.26.12.119, 104.26.13.119, 172.67.70.172, 2606:4700:20::681a:c77, 2606:4700:20::681a:d77, 2606:4700:20::ac43:46ac |
| Redirect IPs | 104.26.12.119, 104.26.13.119, 172.67.70.172, 2606:4700:20::681a:c77, 2606:4700:20::681a:d77, 2606:4700:20::ac43:46ac |
| Response IP | 172.67.70.172 |
| Found | Yes |
| Hash | b9f23b7d5c831791ddbbe598cf8645a34313a2b8626250293be863a21d24ef49 |
| SimHash | a84c040448d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /images/disk/ |
| Disallow | /talent/ |
| Disallow | /draft/ |
| Disallow | /*?_rsc=* |
| Disallow | /*%26_rsc%3D* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.index.dev/sitemap.xml |
| sitemap | https://www.index.dev/image-sitemap.xml |
| sitemap | https://www.index.dev/interview-questions-sitemap.xml |