bolshoyforum.com
robots.txt
Robots Exclusion Standard data for bolshoyforum.com
Resource Scan
Scan Details
Site Domain | bolshoyforum.com |
Base Domain | bolshoyforum.com |
Scan Status | Ok |
Last Scan | 2024-09-20T20:05:36+00:00 |
Next Scan | 2024-09-27T20:05:36+00:00 |
Last Scan
Scanned | 2024-09-20T20:05:36+00:00 |
URL | http://bolshoyforum.com/robots.txt |
Domain IPs | 79.174.76.129 |
Response IP | 79.174.76.129 |
Found | Yes |
Hash | b110512f0ccf53250e45e7ef05833c4b23b49bf8a0dc614c2ef6cb65b90f092e |
SimHash | 0e248eb18a19 |
Groups
*
Rule | Path |
---|---|
Disallow | /wiki/Special |
Allow | /$ |
Allow | /*.xml |
Allow | /forum/$ |
Allow | /forum/*.xml |
Allow | /forum/*sitemap |
Allow | /forum/*page |
Allow | /forum/*action%3Dforum |
Allow | /forum/*action%3Dfelblog |
Allow | /forum/*action%3Dlinks |
Allow | /forum/*action%3Dsitemap |
Allow | /forum/*action%3D.xml |
Disallow | /forum/attachments/ |
Disallow | /forum/avatars/ |
Disallow | /forum/Packages/ |
Disallow | /forum/Smileys/ |
Disallow | /forum/Sources/ |
Disallow | /forum/*msg |
Disallow | /forum/*profile |
Disallow | /forum/*help |
Disallow | /forum/*search |
Disallow | /forum/*mlist |
Disallow | /forum/*sort |
Disallow | /forum/*recent |
Disallow | /forum/*register |
Disallow | /forum/*groups |
Disallow | /forum/*stats |
Disallow | /forum/*unread |
Disallow | /forum/*topicseen |
Disallow | /forum/*showtopic |
Disallow | /forum/*prev_next |
Disallow | /forum/*imode |
Disallow | /forum/*wap |
Disallow | /forum/*all |
Disallow | /forum/*action |
Disallow | /forum/*PHPSESSID |
Disallow | /*action%3Dgo%3B |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | http://bolshoyforum.com/sitemap.xml |
sitemap | http://bolshoyforum.com/forum/index.php?action=sitemap;xml |
sitemap | http://bolshoyforum.com/wiki/sitemap.php |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.