busovod.ru
robots.txt
Robots Exclusion Standard data for busovod.ru
Resource Scan
Scan Details
Site Domain | busovod.ru |
Base Domain | busovod.ru |
Scan Status | Ok |
Last Scan | 2024-05-14T17:51:51+00:00 |
Next Scan | 2024-05-21T17:51:51+00:00 |
Last Scan
Scanned | 2024-05-14T17:51:51+00:00 |
URL | https://busovod.ru/robots.txt |
Domain IPs | 104.21.15.184, 172.67.163.195, 2606:4700:3032::6815:fb8, 2606:4700:3035::ac43:a3c3 |
Response IP | 104.21.15.184 |
Found | Yes |
Hash | 9e625b19107f21ccccbfc122d0b96b76856a15e20f44178013b023827dd95d16 |
SimHash | 283ad8ac02a6 |
Groups
*
Rule | Path |
---|---|
Disallow | /?* |
Disallow | /adm |
Disallow | /cache |
Disallow | /docs |
Disallow | /files |
Disallow | /includes |
Disallow | /install |
Disallow | /language |
Disallow | /store |
Disallow | /app.php |
Disallow | /common.php |
Disallow | /config.php |
Disallow | /cron.php |
Disallow | /faq.php |
Disallow | /feed.php |
Disallow | /mcp.php |
Disallow | /posting.php |
Disallow | /report.php |
Disallow | /ucp.php |
Disallow | /viewonline.php |
Disallow | /index.php |
Disallow | /memberlist.php |
Disallow | /search.php |
Disallow | /viewtopic.php/*viewtopic.php?* |
Disallow | /viewtopic.php?p=* |
Disallow | /viewtopic.php?f=*&t=* |
Disallow | /viewtopic.php?t=*p=* |
Disallow | /viewtopic.php?f=*p=* |
Disallow | /viewtopic.php?t=*&start=0$ |
Disallow | /viewtopic.php?f=*&start=0$ |
Disallow | /viewtopic.php?*&view=viewpoll |
Disallow | /*%26st%3D* |
Disallow | /*%26sk%3D* |
Disallow | /*%26sd%3D* |
Disallow | /*%26hilit%3D* |
Disallow | /*%26view%3D* |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://busovod.ru/sitemap.xml |