hpforum.ru
robots.txt
Robots Exclusion Standard data for hpforum.ru
Resource Scan
Scan Details
| Site Domain | hpforum.ru |
| Base Domain | hpforum.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-02T12:31:36+00:00 |
| Next Scan | 2024-10-09T12:31:36+00:00 |
Last Scan
| Scanned | 2024-10-02T12:31:36+00:00 |
| URL | https://hpforum.ru/robots.txt |
| Domain IPs | 45.130.41.92 |
| Response IP | 45.130.41.92 |
| Found | Yes |
| Hash | 9cde3ce38ac16cda375a44de65f227a025a1033417fca6fb06b022fdedd163f9 |
| SimHash | 39c8be8bcb81 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /album.php |
| Disallow | /album_cat.php |
| Disallow | /album_comment.php |
| Disallow | /album_personal.php |
| Disallow | /album_pic.php |
| Disallow | /faq.php |
| Disallow | /mcp.php |
| Disallow | /memberlist.php |
| Disallow | /posting.php |
| Disallow | /profile.php |
| Disallow | /report.php |
| Disallow | /search.php |
| Disallow | /style.php |
| Disallow | /ucp.php |
| Disallow | /viewtopic.php?p=* |
| Disallow | /viewtopic.php?f=*&t=*&start=0$ |
| Disallow | /11111/ |
| Disallow | /download/ |
| Disallow | /gallery/ |
| Disallow | /files/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
yandex
| Rule | Path |
|---|---|
| Disallow | /album.php |
| Disallow | /album_cat.php |
| Disallow | /album_comment.php |
| Disallow | /album_personal.php |
| Disallow | /album_pic.php |
| Disallow | /faq.php |
| Disallow | /mcp.php |
| Disallow | /memberlist.php |
| Disallow | /posting.php |
| Disallow | /profile.php |
| Disallow | /report.php |
| Disallow | /search.php |
| Disallow | /style.php |
| Disallow | /ucp.php |
| Disallow | /viewtopic.php?p=* |
| Disallow | /viewtopic.php?f=*&t=*&start=0$ |
| Disallow | /11111/ |
| Disallow | /download/ |
| Disallow | /gallery/ |
| Disallow | /files/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.