gireddevils.org
robots.txt
Robots Exclusion Standard data for gireddevils.org
Resource Scan
Scan Details
| Site Domain | gireddevils.org |
| Base Domain | gireddevils.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-01-11T02:06:17+00:00 |
| Next Scan | 2026-01-18T02:06:17+00:00 |
Last Successful Scan
| Scanned | 2025-11-26T15:33:08+00:00 |
| URL | https://gireddevils.org/robots.txt |
| Domain IPs | 13.216.236.23, 3.229.147.70, 44.196.211.67, 52.204.3.241 |
| Response IP | 3.229.147.70 |
| Found | Yes |
| Hash | 140d3fd80244aa1906be42cdfda560046908fabccb4960476741555654f54f8e |
| SimHash | f31ee1b0e3a9 |
Groups
amazon-kendra
| Product | Comment |
|---|---|
| amazon-kendra | Amazon Kendra Web Crawler |
| Rule | Path | Comment |
|---|---|---|
| Disallow | / | disallow access to any pages |
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /cfformprotect/ |
| Disallow | /cftags/ |
| Disallow | /common/ |
| Disallow | /config/ |
| Disallow | /export/ |
| Disallow | /fonts/ |
| Disallow | /frameworks/ |
| Disallow | /img/ |
| Disallow | /includes/ |
| Disallow | /layouts/ |
| Disallow | /model/ |
| Disallow | /modules/ |
| Disallow | /services/ |
| Disallow | /src/ |
| Disallow | /udf/ |
| Disallow | /WEB-INF/ |