cyberforum.ru
robots.txt
Robots Exclusion Standard data for cyberforum.ru
Resource Scan
Scan Details
| Site Domain | cyberforum.ru |
| Base Domain | cyberforum.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-01T17:34:09+00:00 |
| Next Scan | 2024-10-08T17:34:09+00:00 |
Last Scan
| Scanned | 2024-10-01T17:34:09+00:00 |
| URL | https://cyberforum.ru/robots.txt |
| Redirect | https://www.cyberforum.ru/robots.txt |
| Redirect Domain | www.cyberforum.ru |
| Redirect Base | cyberforum.ru |
| Domain IPs | 178.208.71.14 |
| Redirect IPs | 178.208.71.14 |
| Response IP | 178.208.71.14 |
| Found | Yes |
| Hash | bbe0e9c33f2aa500d175d9267c625e4561a5e1bdbdae32b2fc8f880b8f9c75e7 |
| SimHash | 2f091ac1c997 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cron.php |
| Disallow | /editpost.php |
| Disallow | /go.php |
| Disallow | /google-search.php |
| Disallow | /login.php |
| Disallow | /misc.php |
| Disallow | /newreply.php |
| Disallow | /newthread.php |
| Disallow | /post_thanks.php |
| Disallow | /private.php |
| Disallow | /register.php |
| Disallow | /redirector.php |
| Disallow | /sendmessage.php |
| Disallow | /search.php |
| Disallow | /thumbs.php |
| Disallow | /thumbs_center.php |
| Disallow | /yandex-search.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
yandex
| Rule | Path |
|---|---|
| Disallow | /cron.php |
| Disallow | /editpost.php |
| Disallow | /go.php |
| Disallow | /google-search.php |
| Disallow | /login.php |
| Disallow | /misc.php |
| Disallow | /newreply.php |
| Disallow | /newthread.php |
| Disallow | /post_thanks.php |
| Disallow | /private.php |
| Disallow | /register.php |
| Disallow | /redirector.php |
| Disallow | /sendmessage.php |
| Disallow | /search.php |
| Disallow | /thumbs.php |
| Disallow | /thumbs_center.php |
| Disallow | /yandex-search.php |
googlebot
| Rule | Path |
|---|---|
| Disallow | /cron.php |
| Disallow | /editpost.php |
| Disallow | /go.php |
| Disallow | /google-search.php |
| Disallow | /login.php |
| Disallow | /misc.php |
| Disallow | /newreply.php |
| Disallow | /newthread.php |
| Disallow | /post_thanks.php |
| Disallow | /private.php |
| Disallow | /register.php |
| Disallow | /redirector.php |
| Disallow | /sendmessage.php |
| Disallow | /search.php |
| Disallow | /thumbs.php |
| Disallow | /thumbs_center.php |
| Disallow | /yandex-search.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cyberforum.ru/sitemap_index.xml.gz |
Warnings
- `clean-param` is not a known field.