devin.com
robots.txt
Robots Exclusion Standard data for devin.com
Resource Scan
Scan Details
| Site Domain | devin.com |
| Base Domain | devin.com |
| Scan Status | Ok |
| Last Scan | 2025-08-19T20:28:45+00:00 |
| Next Scan | 2025-09-18T20:28:45+00:00 |
Last Scan
| Scanned | 2025-08-19T20:28:45+00:00 |
| URL | https://devin.com/robots.txt |
| Domain IPs | 35.247.83.121 |
| Response IP | 35.247.83.121 |
| Found | Yes |
| Hash | c28d77809e020eae1dadd560526b30734b6775d304366f0f2363de02c8a3526a |
| SimHash | f05d41d0c380 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /img/ |
| Disallow | /pictures/ |
| Disallow | /needadevin.html |
| Disallow | /cgi-bin/ |
| Disallow | /cgi/ |
| Disallow | /visiting_ips |
| Disallow | /cds/ |
| Disallow | /icons/ |
| Disallow | /TURN/ |
| Disallow | /peaches/ |
| Disallow | /cherries/ |
| Disallow | /kumquats/ |
| Disallow | /freshfruit/ |
| Disallow | /echoes/mp3.html |
| Disallow | /echoes/mp3/ |
| Disallow | /toothygrin/ |
| Disallow | /resume/ |
| Disallow | /sawmill/ |
| Disallow | /sawfish/ |
| Disallow | /cruft/lc/ |
| Disallow | /cruft/draw/ |
| Disallow | /penisspam/lumberjack/ |
| Disallow | /cr/ |
| Disallow | /tinker/baby-name-popularity/data |