mostalk.ru
robots.txt
Robots Exclusion Standard data for mostalk.ru
Resource Scan
Scan Details
Site Domain | mostalk.ru |
Base Domain | mostalk.ru |
Scan Status | Ok |
Last Scan | 5/16/2025, 1:37:59 AM |
Next Scan | 5/23/2025, 1:37:59 AM |
Last Scan
Scanned | 5/16/2025, 1:37:59 AM |
URL | https://mostalk.ru/robots.txt |
Domain IPs | 104.21.76.39, 172.67.186.154 |
Response IP | 104.21.76.39 |
Found | Yes |
Hash | c801b04f53e565f30054b303cb410d63213cde90be1f8aee0533becc13ecb8c4 |
SimHash | 003ad8ac0a86 |
Groups
*
Rule | Path |
---|---|
Disallow | /?* |
Disallow | /adm |
Disallow | /cache |
Disallow | /docs |
Disallow | /files |
Disallow | /includes |
Disallow | /install |
Disallow | /language |
Disallow | /store |
Disallow | /app.php |
Disallow | /common.php |
Disallow | /config.php |
Disallow | /cron.php |
Disallow | /faq.php |
Disallow | /feed |
Disallow | /mcp.php |
Disallow | /posting.php |
Disallow | /report.php |
Disallow | /ucp.php |
Disallow | /viewonline.php |
Disallow | /index.php |
Disallow | /memberlist.php |
Disallow | /search.php |
Disallow | /viewtopic.php/*viewtopic.php?* |
Disallow | /viewtopic.php?p=* |
Disallow | /viewtopic.php?f=*&t=* |
Disallow | /viewtopic.php?t=*p=* |
Disallow | /viewtopic.php?f=*p=* |
Disallow | /viewtopic.php?t=*&start=0$ |
Disallow | /viewtopic.php?f=*&start=0$ |
Disallow | /viewtopic.php?*&view=viewpoll |
Disallow | /*%26st%3D* |
Disallow | /*%26sk%3D* |
Disallow | /*%26sd%3D* |
Disallow | /*%26hilit%3D* |
Disallow | /*%26view%3D* |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://mostalk.ru/sitemap.xml |