awdev.eu.org
robots.txt
Robots Exclusion Standard data for awdev.eu.org
Resource Scan
Scan Details
| Site Domain | awdev.eu.org |
| Base Domain | awdev.eu.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-12-05T05:23:17+00:00 |
| Next Scan | 2026-01-04T05:23:17+00:00 |
Last Successful Scan
| Scanned | 2025-11-05T11:18:08+00:00 |
| URL | https://www.awdev.eu.org/robots.txt |
| Domain IPs | 104.21.54.139, 172.67.138.252, 2606:4700:3035::ac43:8afc, 2606:4700:3036::6815:368b |
| Response IP | 172.67.138.252 |
| Found | Yes |
| Hash | 768b2fd77757e3dcffb2c116ab08e27cece3d5ea67d42085180224e7e2043213 |
| SimHash | 2c54d5935511 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | /sitemap.xml |
| sitemap | /sitemap-pages.xml |
| sitemap | /rss.xm |
| sitemap | /atom.xml |
| sitemap | https://www.awdev.eu.org/sitemap.xml |
| sitemap | https://www.awdev.eu.org/rss.xml |
| sitemap | https://www.awdev.eu.org/atom.xml |