crucials.io
robots.txt
Robots Exclusion Standard data for crucials.io
Resource Scan
Scan Details
| Site Domain | crucials.io |
| Base Domain | crucials.io |
| Scan Status | Ok |
| Last Scan | 4/9/2025, 11:16:35 PM |
| Next Scan | 5/9/2025, 11:16:35 PM |
Last Scan
| Scanned | 4/9/2025, 11:16:35 PM |
| URL | https://crucials.io/robots.txt |
| Domain IPs | 104.21.71.73, 172.67.143.228, 2606:4700:3037::6815:4749, 2606:4700:3037::ac43:8fe4 |
| Response IP | 172.67.143.228 |
| Found | Yes |
| Hash | 699a3daf7c1ec965bca36a585e553aa5b9cb92161737d631bfceb3717531159f |
| SimHash | 6d1059148190 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /.well-known/ |
| Disallow | /*.png$ |
| Disallow | /*.jpg$ |
| Disallow | /*.css$ |
| Disallow | /*.js$ |
| Disallow | /*.php$ |
| Disallow | /*.gif$ |
| Disallow | /*.jpeg$ |
| Disallow | /*.bmp$ |
| Disallow | /*.svg$ |
| Disallow | /*.webp$ |
| Disallow | /*.ico$ |