desteni.org
robots.txt
Robots Exclusion Standard data for desteni.org
Resource Scan
Scan Details
| Site Domain | desteni.org |
| Base Domain | desteni.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-08-31T13:38:27+00:00 |
| Next Scan | 2025-11-29T13:38:27+00:00 |
Last Successful Scan
| Scanned | 2025-04-10T19:01:51+00:00 |
| URL | https://desteni.org/robots.txt |
| Domain IPs | 104.21.57.173, 172.67.147.222, 2606:4700:3034::6815:39ad, 2606:4700:3035::ac43:93de |
| Response IP | 172.67.147.222 |
| Found | Yes |
| Hash | acded8f9d706e6c0426b0aa2a1c774a36bfdde469c11e9833ea2bef00297c9e3 |
| SimHash | 7e88148aa194 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /application/attributes |
| Disallow | /application/authentication |
| Disallow | /application/bootstrap |
| Disallow | /application/config |
| Disallow | /application/controllers |
| Disallow | /application/elements |
| Disallow | /application/helpers |
| Disallow | /application/jobs |
| Disallow | /application/languages |
| Disallow | /application/mail |
| Disallow | /application/models |
| Disallow | /application/page_types |
| Disallow | /application/single_pages |
| Disallow | /application/tools |
| Disallow | /application/views |
| Disallow | /ccm/system/captcha/picture |