deva02.com
robots.txt
Robots Exclusion Standard data for deva02.com
Resource Scan
Scan Details
Site Domain | deva02.com |
Base Domain | deva02.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-07-13T17:51:10+00:00 |
Next Scan | 2025-08-12T17:51:10+00:00 |
Last Successful Scan
Scanned | 2025-05-21T23:21:35+00:00 |
URL | https://deva02.com/robots.txt |
Domain IPs | 104.21.91.62, 172.67.211.28, 2606:4700:3035::ac43:d31c, 2606:4700:3037::6815:5b3e |
Response IP | 172.67.211.28 |
Found | Yes |
Hash | 6feb9c6fcba99253b96573a40ea9018cfc132c1dd79501c3155f3c2a7bd83466 |
SimHash | 294808418792 |
Groups
*
Rule | Path |
---|---|
Allow | /*.js |
Allow | /*.css |
Allow | *?page=* |
Disallow | /*.php |
Disallow | /cgi-bin |
Disallow | *utm*%3D |
Disallow | *openstat%3D |
Disallow | /*?* |
Disallow | /manager/ |
Disallow | /install/ |
Disallow | /assets/cache/ |
Disallow | /assets/docs/ |
Disallow | /assets/export/ |
Disallow | /assets/import/ |
Disallow | /assets/modules/ |
Disallow | /assets/plugins/ |
Disallow | /assets/snippets/ |
Disallow | /lichnyij-kabinet/ |
Disallow | /novosti/ |
Disallow | /lichnyie-soobshheniya.html/ |
Disallow | /rasshirennyij-poisk.html/ |
Disallow | /assets/components/phpthumbof/cache/* |
Disallow | /assets/images/user/* |
Disallow | /dobavit-anketu.html |
Disallow | /anketyi.html |
Disallow | /zagruzka-proverochnogo-foto.html |
Disallow | /redaktirovanie-anketyi.html |
Disallow | /udalenie-anket.html |
Disallow | /chernyij-spisok.html |
Disallow | /nastrojki-profilya.html |
Disallow | /popolnenie-scheta.html |
Disallow | /izbrannoe.html |
Disallow | /otzyivyi.html |
Disallow | /aktivacziya-akkaunta.html |
Disallow | /vosstanovlenie-parolya.html |
Disallow | /aktivirovan.html |
Other Records
Field | Value |
---|---|
sitemap | https://deva02.com/sitemap.xml |
Warnings
- `host` is not a known field.
Comments