ro-fan.ru
robots.txt
Robots Exclusion Standard data for ro-fan.ru
Resource Scan
Scan Details
| Site Domain | ro-fan.ru |
| Base Domain | ro-fan.ru |
| Scan Status | Ok |
| Last Scan | 2026-02-05T03:02:43+00:00 |
| Next Scan | 2026-03-07T03:02:43+00:00 |
Last Scan
| Scanned | 2026-02-05T03:02:43+00:00 |
| URL | https://ro-fan.ru/robots.txt |
| Domain IPs | 2a0a:9300::1002, 5.252.116.9 |
| Response IP | 5.252.116.9 |
| Found | Yes |
| Hash | 0302b0d9b09df8ca8f8ab10072fa3ee7427199a0eaf0ffe9875cffec22c8a4bb |
| SimHash | 721c1861e2a8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /images/ |
| Disallow | /language/ |
| Disallow | /tmp/ |
| Disallow | /memberlist.php |
| Disallow | /posting.php |
| Disallow | /search.php |
| Disallow | /ucp.php |
| Disallow | /app.php/help/ |
| Disallow | /wiki*/api.php |
| Disallow | /wiki*/load.php |
| Disallow | /wiki*/MediaWiki%3A |
| Disallow | /wiki*/Special%3A |
| Disallow | /wiki*/Special%3A |
| Disallow | /wiki*/%D0%A1%D0%BB%D1%83%D0%B6%D0%B5%D0%B1%D0%BD%D0%B0%D1%8F%3A |
| Disallow | /wiki*/%D0%A1%D0%BF%D1%80%D0%B0%D0%B2%D0%BA%D0%B0%3A |
| Disallow | /wiki*/index.php?title=*&action=edit |
| Disallow | /wiki*/index.php?title=*&oldid= |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ro-fan.ru/sitemap.xml |
| sitemap | https://ro-fan.ru/wiki/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments