webznayka.ru
robots.txt
Robots Exclusion Standard data for webznayka.ru
Resource Scan
Scan Details
| Site Domain | webznayka.ru |
| Base Domain | webznayka.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-20T02:10:27+00:00 |
| Next Scan | 2024-09-27T02:10:27+00:00 |
Last Scan
| Scanned | 2024-09-20T02:10:27+00:00 |
| URL | https://webznayka.ru/robots.txt |
| Domain IPs | 87.236.16.169 |
| Response IP | 87.236.16.169 |
| Found | Yes |
| Hash | 32bf506cbb489b9c539dc9d8af4a2d256035a74750755c9ebed17a3fc71773c3 |
| SimHash | 4f2e4ff0705a |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /administrator/ | - |
| Disallow | /api/ | - |
| Disallow | /bin/ | - |
| Disallow | /cache/ | - |
| Disallow | /cli/ | - |
| Disallow | /components/ | - |
| Disallow | /component/ | - |
| Disallow | /includes/ | - |
| Disallow | /installation/ | - |
| Disallow | /language/ | - |
| Disallow | /layouts/ | - |
| Disallow | /libraries/ | - |
| Disallow | /logs/ | - |
| Disallow | /media/ | - |
| Disallow | /modules/ | - |
| Disallow | /plugins/ | - |
| Disallow | /templates/ | - |
| Disallow | /tmp/ | - |
| Disallow | /*archive | - |
| Disallow | /index.php* | - |
| Disallow | /index2.php* | - |
| Disallow | /*com_mailto | - |
| Disallow | /*pop%3D | - |
| Disallow | /*format%3D | - |
| Disallow | /*print%3D | - |
| Disallow | /*user/ | - |
| Disallow | /index2.php | - |
| Disallow | /index.php | - |
| Disallow | /*? | - |
| Disallow | /*% | - |
| Disallow | /*%26 | - |
| Disallow | /*%3Datom | RSS |
| Disallow | /*%3Drss | RSS |
| Disallow | /*?view=featured | - |
| Disallow | /component/users/ | - |
| Disallow | /component/content/?view=featured | - |
| Disallow | /*feed* | - |
| Disallow | /*search | - |
| Disallow | /*tag | - |
| Disallow | /*tags | - |
| Disallow | /*/page-* | - |
| Disallow | /page-* | - |
| Disallow | /*uncategorised | - |
| Disallow | /*users | - |
| Disallow | /*?format | - |
| Disallow | /*?itemid | - |
| Disallow | /*?searchword | - |
| Disallow | /*?start | - |
| Disallow | /*?tagid | - |
| Disallow | /*?tmpl=component | - |
| Disallow | /*?type | - |
| Disallow | /*?view=article | - |
| Disallow | /*?view=category | - |
| Disallow | /*?view=registration | - |
| Allow | /images/ | - |
| Allow | /media/*.css | - |
| Allow | /media/*.js | - |
| Allow | /*.js* | - |
| Allow | /*.css* | - |
| Allow | /*.png* | - |
| Allow | /*.jpg* | - |
| Allow | /*.gif* | - |
| Allow | /*.jpeg* | - |
| Allow | /*.webp* | - |
| Allow | /*.ico | - |
| Allow | /templates/*.css | - |
| Allow | /templates/*.js | - |
| Allow | /templates/*.jpg | - |
| Allow | /templates/*.png | - |
| Allow | /templates/*.jpg | - |
| Allow | /templates/*.gif | - |
| Allow | /templates/*.ico | - |
| Allow | /images/ | - |
| Allow | /index.php?option=com_jmap&view=sitemap&format=xml | - |
| Allow | /sitemap-4seo | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://webznayka.ru/sitemap.xml |
| sitemap | https://webznayka.ru/sitemap-4seo.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.