melnikov-tex.ru
robots.txt
Robots Exclusion Standard data for melnikov-tex.ru
Resource Scan
Scan Details
| Site Domain | melnikov-tex.ru |
| Base Domain | melnikov-tex.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-03T14:46:27+00:00 |
| Next Scan | 2024-07-03T14:46:27+00:00 |
Last Scan
| Scanned | 2024-06-03T14:46:27+00:00 |
| URL | https://melnikov-tex.ru/robots.txt |
| Domain IPs | 2a00:f940:2:2:1:1:0:231, 31.31.198.8 |
| Response IP | 31.31.198.8 |
| Found | Yes |
| Hash | de811da202a0da2c60170f0808e3030e3b44e1e23adb6f93458c5df7043a7816 |
| SimHash | 00010d4437d7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajaxmegasearch/ |
| Disallow | /manager/ |
| Disallow | /assets/components/ |
| Disallow | /core/ |
| Allow | /assets/components/*.js* |
| Allow | /assets/components/*.js$ |
| Allow | /assets/components/*.css$ |
| Allow | /assets/components/*.css* |
| Allow | /assets/components/*.jpg |
| Allow | /assets/components/*.png |
| Allow | /assets/css/*.css* |
| Allow | /assets/js/*.js* |
| Disallow | /connectors/ |
| Disallow | /index.php |
| Disallow | /index.html |
| Disallow | /index |
| Disallow | *? |
Other Records
| Field | Value |
|---|---|
| sitemap | https://melnikov-tex.ru/sitemap.xml |
| sitemap | https://melnikov-tex.ru/sitemap.xml |
Warnings
- `host` is not a known field.