milli.az
robots.txt
Robots Exclusion Standard data for milli.az
Resource Scan
Scan Details
| Site Domain | milli.az |
| Base Domain | milli.az |
| Scan Status | Ok |
| Last Scan | 2024-11-06T02:02:41+00:00 |
| Next Scan | 2024-11-13T02:02:41+00:00 |
Last Scan
| Scanned | 2024-11-06T02:02:41+00:00 |
| URL | https://milli.az/robots.txt |
| Redirect | https://www.milli.az/robots.txt |
| Redirect Domain | www.milli.az |
| Redirect Base | milli.az |
| Domain IPs | 104.26.12.219, 104.26.13.219, 172.67.68.191, 2606:4700:20::681a:cdb, 2606:4700:20::681a:ddb, 2606:4700:20::ac43:44bf |
| Redirect IPs | 104.26.12.219, 104.26.13.219, 172.67.68.191, 2606:4700:20::681a:cdb, 2606:4700:20::681a:ddb, 2606:4700:20::ac43:44bf |
| Response IP | 104.26.13.219 |
| Found | Yes |
| Hash | 5e30b7afbf310d03d660f80f39ca097def0e554ab5b1ba83373e4ba4f5097720 |
| SimHash | 04008f430395 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /index.php |
| Disallow | /search.php |
| Disallow | /bottom_news_mobile.php |
| Allow | /poll/ |
| Allow | /js/ |
| Allow | /css/ |
| Allow | /images/ |
Warnings
- `host` is not a known field.