it-skills.online
robots.txt
Robots Exclusion Standard data for it-skills.online
Resource Scan
Scan Details
| Site Domain | it-skills.online |
| Base Domain | it-skills.online |
| Scan Status | Ok |
| Last Scan | 2025-12-19T07:20:05+00:00 |
| Next Scan | 2026-01-18T07:20:05+00:00 |
Last Scan
| Scanned | 2025-12-19T07:20:05+00:00 |
| URL | https://it-skills.online/robots.txt |
| Domain IPs | 87.236.16.8 |
| Response IP | 87.236.16.8 |
| Found | Yes |
| Hash | 358d6972bb9ba6ee672ed754b8e6bd50596e9f3d8edb248041b042bddb33c6ca |
| SimHash | 497ecfd0e0d1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /lostpass?email=* |
| Disallow | /buy* |
| Disallow | /blog?start=* |
| Disallow | /training/view/kompleksnoe-obuchenie-sistemnomu-administrirovaniyu/* |
| Disallow | /training/view/zabbix-monitoring-it* |
| Disallow | /training/view/centr-podgotovki-it-specialistov/* |
| Disallow | /training/view/internet-kontrol-server/* |
| Disallow | /pay/* |
| Disallow | /training/lesson/options/* |
| Disallow | /feedback* |
| Disallow | /reviews/add* |
| Disallow | /forum/branch/* |
| Disallow | /admin/ |
| Disallow | /backend/ |
| Disallow | /control/ |
| Disallow | /dashboard/ |
| Disallow | /cp/ |
| Disallow | /application/ |
| Disallow | /config/ |
| Disallow | /database/ |
| Disallow | /lib/ |
| Disallow | /system/ |
| Disallow | /vendor/ |
| Disallow | /cache/ |
| Disallow | /logs/ |
| Disallow | /temp/ |
| Disallow | /search/ |
| Disallow | /*?q= |
| Disallow | /*?search= |
| Disallow | /*?filter_ |
| Disallow | /*?sort= |
| Disallow | /*?order= |
| Disallow | /*?utm_ |
| Disallow | /*?gclid= |
| Disallow | /*?yclid= |
| Disallow | /*?fbclid= |
| Disallow | /personal/ |
| Disallow | /private/ |
| Disallow | /user/ |
| Disallow | /users/ |
| Disallow | /profile/ |
| Disallow | /profiles/ |
| Disallow | /account/ |
| Disallow | /accounts/ |
| Disallow | /cart/ |
| Disallow | /basket/ |
| Disallow | /checkout/ |
| Disallow | /order/ |
| Disallow | /payment/ |
| Allow | /assets/*.css$ |
| Allow | /assets/*.js$ |
| Allow | /assets/*.png$ |
| Allow | /assets/*.jpg$ |
| Allow | /assets/*.jpeg$ |
| Allow | /assets/*.gif$ |
| Allow | /assets/*.svg$ |
| Allow | /assets/*.webp$ |
| Allow | /fonts/ |
dotbot
| Rule | Path |
|---|---|
| Disallow | /components |
| Disallow | /config |
| Disallow | /controllers |
| Disallow | /lang |
| Disallow | /lib |
| Disallow | /load |
| Disallow | /models |
| Disallow | /payments |
| Disallow | /task |
| Disallow | /template/ |
| Disallow | /vendor |
| Disallow | /tmp |
| Allow | /template/master/images |
| Allow | /template/master/js |
| Allow | /template/master/css |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Warnings
- 1 invalid line.
- `clean-param` is not a known field.
Comments