news.milli.az
robots.txt
Robots Exclusion Standard data for news.milli.az
Resource Scan
Scan Details
| Site Domain | news.milli.az |
| Base Domain | milli.az |
| Scan Status | Ok |
| Last Scan | 2025-12-10T13:05:13+00:00 |
| Next Scan | 2026-01-09T13:05:13+00:00 |
Last Scan
| Scanned | 2025-12-10T13:05:13+00:00 |
| URL | https://news.milli.az/robots.txt |
| Domain IPs | 104.26.12.219, 104.26.13.219, 172.67.68.191, 2606:4700:20::681a:cdb, 2606:4700:20::681a:ddb, 2606:4700:20::ac43:44bf |
| Response IP | 104.26.12.219 |
| Found | Yes |
| Hash | d6d0acaade36545c57fb94d008997213977e5f8d09871bb3b23e5d3994dfa673 |
| SimHash | 6c08a845cbb1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /index.php |
| Disallow | /search.php |
| Disallow | /bottom_news_mobile.php |
| Disallow | /30175131/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://news.milli.az/sitemap_latest.php |
Warnings
- `host` is not a known field.