azerweb.az
robots.txt
Robots Exclusion Standard data for azerweb.az
Resource Scan
Scan Details
| Site Domain | azerweb.az |
| Base Domain | azerweb.az |
| Scan Status | Ok |
| Last Scan | 2026-03-06T01:51:38+00:00 |
| Next Scan | 2026-04-05T01:51:38+00:00 |
Last Scan
| Scanned | 2026-03-06T01:51:38+00:00 |
| URL | https://azerweb.az/robots.txt |
| Domain IPs | 104.21.12.27, 172.67.131.232, 2606:4700:3031::ac43:83e8, 2606:4700:3036::6815:c1b |
| Response IP | 172.67.131.232 |
| Found | Yes |
| Hash | 37159e0a8ebad79a173e4301c3e51eec6dad285b999faf175faacf484ddca394 |
| SimHash | d6351043d515 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /ach |
| Disallow | /adminsite |
| Disallow | /adra |
| Disallow | /aylu |
| Disallow | /chf |
| Disallow | /classes |
| Disallow | /conf |
| Disallow | /crs |
| Disallow | /ecy |
| Disallow | /fs |
| Disallow | /icons |
| Disallow | /ifes |
| Disallow | /imc |
| Disallow | /iom |
| Disallow | /iri |
| Disallow | /lotos |
| Disallow | /maps |
| Disallow | /mc |
| Disallow | /news |
| Disallow | /nnf |
| Disallow | /php |
| Disallow | /piligrim |
| Disallow | /scripts |
| Disallow | /sdescr |
| Disallow | /sdyoa |
| Disallow | /srpc |
| Disallow | /uafa |
| Disallow | /umcor |
| Disallow | /usaid |
Warnings
- `content-signal` is not a known field.
Comments