24au.ru
robots.txt
Robots Exclusion Standard data for 24au.ru
Resource Scan
Scan Details
| Site Domain | 24au.ru |
| Base Domain | 24au.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-08T02:15:22+00:00 |
| Next Scan | 2024-10-08T02:15:22+00:00 |
Last Scan
| Scanned | 2024-09-08T02:15:22+00:00 |
| URL | http://24au.ru/robots.txt |
| Domain IPs | 95.172.129.187, 95.172.129.188 |
| Response IP | 95.172.129.187 |
| Found | Yes |
| Hash | ea30217a23bfb3504dbcc5d143c9e45efb2580895077c1e7482b67f4b54d7a6d |
| SimHash | 4882de35a003 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/favorite/ |
| Disallow | /*/Like/ |
| Disallow | /*/sale |
| Disallow | /*/OtherItemsInCategory/ |
| Disallow | /*/UpdateViews/ |
| Disallow | /*?a=r |
| Disallow | /*?bp |
| Disallow | /*?cat |
| Disallow | /*?category |
| Disallow | /*?change |
| Disallow | /*?dir |
| Disallow | /*?enable_description |
| Disallow | /*?enable_video |
| Disallow | /*?filter |
| Disallow | /*?find |
| Disallow | /*?find_str |
| Disallow | /*?idLandmark |
| Disallow | /*?jsAction |
| Disallow | /*?landmark |
| Disallow | /*?location |
| Disallow | /*?LSort |
| Disallow | /*?price_end |
| Disallow | /*?regionToCookie |
| Disallow | /*?seller |
| Disallow | /*?search |
| Disallow | /*?sort |
| Disallow | /*?type |
| Disallow | /*?ui |
| Disallow | /*?url_cat |
| Disallow | /*%26dir |
| Disallow | /*%26enable_description |
| Disallow | /*%26enable_video |
| Disallow | /*%26find_str |
| Disallow | /*%26change |
| Disallow | /*%26landmark |
| Disallow | /*%26price_end |
| Disallow | /*%26search |
| Disallow | /*%26sort |
| Disallow | /*%26type |
| Disallow | /?%2F$ |
| Disallow | /about |
| Disallow | /action |
| Disallow | /admin |
| Disallow | /advertoff/ |
| Disallow | /appeal |
| Disallow | /blacklist |
| Disallow | /catalog |
| Disallow | /citypay |
| Disallow | /compareusertable |
| Disallow | /confirmrules |
| Disallow | /croncloser |
| Disallow | /cronclosertender |
| Disallow | /cronmailer |
| Disallow | /cronsmsupdater |
| Disallow | /details |
| Disallow | /deferred |
| Disallow | /edit |
| Disallow | /editsale |
| Disallow | /edittender |
| Disallow | /feed/test-monday/ |
| Disallow | /informer |
| Disallow | /item |
| Disallow | /itemsnapshot/ |
| Disallow | /linker |
| Disallow | /login |
| Disallow | /messages |
| Disallow | /message/gethistory/ |
| Disallow | /migrate/ |
| Disallow | /moderator |
| Disallow | /moderatorcompliants |
| Disallow | /new/GetCategoryList/ |
| Disallow | /new/GetValueSubList/ |
| Disallow | /newauction |
| Disallow | /newpassword |
| Disallow | /newuser |
| Disallow | /nextitem/ |
| Disallow | /old/ |
| Disallow | /registration/ |
| Disallow | /review/?ID= |
| Disallow | /service |
| Disallow | /smspay |
| Disallow | /social |
| Disallow | /tender/ |
| Disallow | /tenders/ |
| Disallow | |
| Disallow | /userblacklist |
| Disallow | /test |
| Disallow | /u/ |
| Disallow | /usertooltip/ |
| Disallow | /utils |
| Disallow | /nextauction |
Other Records
| Field | Value |
|---|---|
| sitemap | https://au.ru/sitemaps/sitemap.xml |
Warnings
- `host` is not a known field.