metalarea.ru
robots.txt
Robots Exclusion Standard data for metalarea.ru
Resource Scan
Scan Details
| Site Domain | metalarea.ru |
| Base Domain | metalarea.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-20T09:08:30+00:00 |
| Next Scan | 2024-06-27T09:08:30+00:00 |
Last Scan
| Scanned | 2024-06-20T09:08:30+00:00 |
| URL | https://metalarea.ru/robots.txt |
| Domain IPs | 104.21.24.107, 172.67.218.85 |
| Response IP | 172.67.218.85 |
| Found | Yes |
| Hash | 452c2d3e8b4f5614d5e2f17db1eb94818f495a2dc89facad8834200dd8061b88 |
| SimHash | 700da078a933 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /engine/* |
| Disallow | /user/ |
| Disallow | /tags/ |
| Disallow | /*/tags/ |
| Disallow | /backup/ |
| Disallow | /cache/ |
| Disallow | /catalog/ |
| Disallow | /lastnews/ |
| Disallow | /language/ |
| Disallow | /newposts/ |
| Disallow | /xfsearch/* |
| Disallow | /favorites/ |
| Disallow | /statistics.html |
| Disallow | /rules.html |
| Disallow | /rss.xml |
| Disallow | /index.php?action=mobile |
| Disallow | /*subaction%3Duserinfo |
| Disallow | /*subaction%3Dnewposts |
| Disallow | /*do%3Dlastcomments |
| Disallow | /*do%3Dfeedback |
| Disallow | /*do%3Dregister |
| Disallow | /*do%3Dlostpassword |
| Disallow | /*do%3Daddnews |
| Disallow | /*do%3Dstats |
| Disallow | /*do%3Dpm |
| Disallow | |
| Disallow | /download |
| Disallow | /f/ |
| Disallow | /index.php?* |
| Disallow | /%3Dsearch* |
| Allow | /engine/classes/js/ |
| Allow | /engine/classes/min/index.php |
| Allow | /engine/data/emoticons/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://metalarea.ru/sitemap.xml |