ax4.ru
robots.txt
Robots Exclusion Standard data for ax4.ru
Resource Scan
Scan Details
| Site Domain | ax4.ru |
| Base Domain | ax4.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-13T05:13:18+00:00 |
| Next Scan | 2024-11-20T05:13:18+00:00 |
Last Scan
| Scanned | 2024-11-13T05:13:18+00:00 |
| URL | https://ax4.ru/robots.txt |
| Domain IPs | 104.21.93.221, 172.67.216.77, 2606:4700:3035::6815:5ddd, 2606:4700:3035::ac43:d84d |
| Response IP | 172.67.216.77 |
| Found | Yes |
| Hash | 6950380cdd6c38039f6a208cf12fb2d5493fe2d6bdf0c47a38dd03cf63dbafa6 |
| SimHash | 3901b8cb8d92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /user/ |
| Disallow | /tags/ |
| Disallow | /favorites/ |
| Disallow | /lastnews/ |
| Disallow | /newposts/ |
| Disallow | /catalog/ |
| Disallow | /print/ |
| Disallow | /addnews.html |
| Disallow | /statistics.html |
| Disallow | /rules.html |
| Disallow | /dle-rules-page.html |
| Disallow | /engine/ |
| Disallow | /*?* |
| Disallow | /admin |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ax4.ru/sitemap.xml |
Warnings
- `host` is not a known field.