forum.instalator.ru
robots.txt
Robots Exclusion Standard data for forum.instalator.ru
Resource Scan
Scan Details
| Site Domain | forum.instalator.ru |
| Base Domain | instalator.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-10T22:49:32+00:00 |
| Next Scan | 2024-11-17T22:49:32+00:00 |
Last Scan
| Scanned | 2024-11-10T22:49:32+00:00 |
| URL | https://forum.instalator.ru/robots.txt |
| Domain IPs | 81.177.143.35 |
| Response IP | 81.177.143.35 |
| Found | Yes |
| Hash | fcc5a46d9a3c186f2bb39d1bde88045cc10f38a62d7ebb1354268d2a86b16249 |
| SimHash | 4e8a9dccea92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /common.php |
| Disallow | /config.php |
| Disallow | /cron.php |
| Disallow | /faq.php |
| Disallow | /groupcp.php |
| Disallow | /login.php |
| Disallow | /mcp.php |
| Disallow | /memberlist.php |
| Disallow | /posting.php |
| Disallow | /privmsg.php |
| Disallow | /profile.php |
| Disallow | /report.php |
| Disallow | /search.php |
| Disallow | /style.php |
| Disallow | /viewonline.php |
| Disallow | /viewforum.php |
| Disallow | /ucp.php |
| Disallow | /viewtopic.php?t=* |
| Disallow | /viewtopic.php?t=*&p=* |
| Disallow | /viewtopic.php?p=* |
| Disallow | /viewforum.php?f=*&start=0$ |
| Disallow | /viewtopic.php?f=*&t=*&start=0$ |
| Disallow | /viewtopic.php?f=*&t=*&view=next |
| Disallow | /viewtopic.php?f=*&t=*&view=previous |
| Disallow | /viewtopic.php?f=*&t=*&p=* |
| Disallow | /adm |
| Disallow | /ads |
| Disallow | /cache |
| Disallow | /docs |
| Disallow | /download |
| Disallow | /files |
| Disallow | /images |
| Disallow | /includes |
| Disallow | /language |
| Disallow | /store |
| Disallow | /styles |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.