modber.ru
robots.txt
Robots Exclusion Standard data for modber.ru
Resource Scan
Scan Details
| Site Domain | modber.ru |
| Base Domain | modber.ru |
| Scan Status | Ok |
| Last Scan | 2025-11-27T22:41:47+00:00 |
| Next Scan | 2025-12-04T22:41:47+00:00 |
Last Scan
| Scanned | 2025-11-27T22:41:47+00:00 |
| URL | https://modber.ru/robots.txt |
| Domain IPs | 104.21.16.116, 172.67.212.9, 2606:4700:3033::6815:1074, 2606:4700:3035::ac43:d409 |
| Response IP | 172.67.212.9 |
| Found | Yes |
| Hash | 113b17ce81fdccc4595b3f7a58c7883c63088a6c593a7c8e7017f73da05b63f5 |
| SimHash | 844411892d62 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /billing/fail.html |
| Disallow | /billing/success.html |
| Disallow | */add.html |
| Disallow | */avatar.html |
| Disallow | */bookmarks/* |
| Disallow | */editprofile.html |
| Disallow | */forum/reply*.html |
| Disallow | */forum/subscribe*.html |
| Disallow | */forum/thread*-quote*.html |
| Disallow | */karma.html |
| Disallow | */messages* |
| Disallow | */newthread.html |
| Disallow | */pinthread*.html |
| Disallow | *?* |
| Disallow | /0 |
| Disallow | /blogs |
| Disallow | /catalog/*find |
| Disallow | /catalog/*find-first |
| Disallow | /catalog/1-* |
| Disallow | /catalog/1001-* |
| Disallow | /catalog/1002-* |
| Disallow | /catalog/1003-* |
| Disallow | /catalog/1004-* |
| Disallow | /catalog/1005-* |
| Disallow | /catalog/1006-* |
| Disallow | /catalog/1008-* |
| Disallow | /catalog/item2487.html |
| Disallow | /catalog/view-post-rating-history* |
| Disallow | /catalog/item*.html?a=* |
| Disallow | /comments |
| Disallow | /find.html |
| Disallow | /forum/0 |
| Disallow | /forum/latest_posts |
| Disallow | /forum/latest_thread |
| Disallow | /forum/thread*-1.html |
| Disallow | /forum/viewpoll*.html |
| Disallow | /go/url%3D* |
| Disallow | /gobanner* |
| Disallow | /index.ph* |
| Disallow | /load* |
| Disallow | /login |
| Disallow | /logout* |
| Disallow | /medias* |
| Disallow | /my.html |
| Disallow | /passremind.html |
| Disallow | /photos |
| Disallow | /quests* |
| Disallow | /registration |
| Disallow | /rss |
| Disallow | /search |
| Disallow | /uploads |
| Disallow | /users |
| Disallow | /users*karma.html |
| Disallow | /users*comments.html |
| Disallow | /users*forumposts.html |
| Disallow | /users*city* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.modber.ru/google_sitemap.xml |
| sitemap | http://www.modber.ru/yandex_sitemap.xml |
Warnings
- `host` is not a known field.
Comments