tuthobby.ru
robots.txt
Robots Exclusion Standard data for tuthobby.ru
Resource Scan
Scan Details
| Site Domain | tuthobby.ru |
| Base Domain | tuthobby.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-23T12:01:30+00:00 |
| Next Scan | 2024-06-30T12:01:30+00:00 |
Last Scan
| Scanned | 2024-06-23T12:01:30+00:00 |
| URL | https://tuthobby.ru/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:7:d2f3, 2a00:15f8:a000:5:1:12:7:d2f3, 2a00:15f8:a000:5:1:13:7:d2f3, 2a00:15f8:a000:5:1:14:7:d2f3, 90.156.201.108, 90.156.201.12, 90.156.201.48, 90.156.201.93 |
| Response IP | 90.156.201.12 |
| Found | Yes |
| Hash | deafbd666f004f70a34e2bae2f69015844e4a1b9eff3ee29f1d895ae19822857 |
| SimHash | 6c2882621793 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /recovery/* |
| Disallow | /activation/* |
| Disallow | /update_email/* |
| Disallow | /update_pass/* |
| Disallow | /profile/* |
| Disallow | /img/sx/big/* |
| Disallow | /img/max/* |
| Disallow | /img/sx/small/* |
| Disallow | /sx_file/* |
| Disallow | /reset/* |
| Disallow | /doc/* |
| Disallow | /admin |
| Disallow | /search |
| Disallow | /img/thanks.jpg |
| Disallow | /sx_file/* |
| Allow | /*.jpg |
| Allow | /*.png |
| Allow | /*.gif |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
yandex
| Rule | Path |
|---|---|
| Disallow | /recovery/* |
| Disallow | /activation/* |
| Disallow | /update_email/* |
| Disallow | /update_pass/* |
| Disallow | /profile/* |
| Disallow | /img/sx/big/* |
| Disallow | /img/sx/small/* |
| Disallow | /doc/* |
| Disallow | /admin |
| Disallow | /search |
| Disallow | /img/thanks.jpg |
| Disallow | /img/max/* |
| Disallow | /sx_file/* |
| Disallow | /reset/* |
| Disallow | /unsubscribe/* |
| Allow | /*.jpg |
| Allow | /*.png |
| Allow | /*.gif |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Warnings
- `host` is not a known field.