dafatir.info
robots.txt
Robots Exclusion Standard data for dafatir.info
Resource Scan
Scan Details
| Site Domain | dafatir.info |
| Base Domain | dafatir.info |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-12-12T04:53:45+00:00 |
| Next Scan | 2026-03-12T04:53:45+00:00 |
Last Successful Scan
| Scanned | 2025-08-13T13:28:23+00:00 |
| URL | https://dafatir.info/robots.txt |
| Domain IPs | 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001 |
| Response IP | 104.21.32.1 |
| Found | Yes |
| Hash | 94004fb3d086a1f5a4fa4a21f42e14535d7921e2cbbc428266fa7f1ef3c859d3 |
| SimHash | 2456c5eb24c5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /internal_data/ |
| Disallow | /library/ |
| Disallow | /src/ |
| Disallow | /js/ |
| Disallow | /styles/ |
| Disallow | /data/ |
| Disallow | /install/ |
| Disallow | /admin.php |
| Disallow | /account/ |
| Disallow | /login/ |
| Disallow | /register/ |
| Disallow | /lost-password/ |
| Disallow | /find-new/ |
| Disallow | /search/ |
| Disallow | /online/ |
| Disallow | /whats-new/ |
| Disallow | /members/ |
| Disallow | /resources/add/ |
| Disallow | /resources/categories/*/add |
| Disallow | /tags/ |
| Disallow | /pages/*/edit |
| Disallow | /help/ |
| Disallow | /*? |
| Disallow | /*%26 |
| Disallow | /*sort%3D |
| Disallow | /*order%3D |
| Disallow | /*direction%3D |
| Disallow | /*page%3D |
| Disallow | /*xfaction%3D |
| Disallow | /*filter%3D |
| Disallow | /*starter%3D |
| Disallow | /*type%3D |
| Allow | / |
| Allow | /forums/ |
| Allow | /threads/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dafatir.info/sitemap.xml |
Comments