vopros-deti.ru
robots.txt
Robots Exclusion Standard data for vopros-deti.ru
Resource Scan
Scan Details
Site Domain | vopros-deti.ru |
Base Domain | vopros-deti.ru |
Scan Status | Ok |
Last Scan | 2024-10-05T08:43:54+00:00 |
Next Scan | 2024-10-12T08:43:54+00:00 |
Last Scan
Scanned | 2024-10-05T08:43:54+00:00 |
URL | https://vopros-deti.ru/robots.txt |
Domain IPs | 104.21.86.26, 172.67.214.60, 2606:4700:3032::6815:561a, 2606:4700:3032::ac43:d63c |
Response IP | 172.67.214.60 |
Found | Yes |
Hash | 63517febf34745d0aa470e5829e6a72cf38449212a23a2dd28c9e3da762884da |
SimHash | 203ad8ac0a86 |
Groups
*
Rule | Path |
---|---|
Disallow | /?* |
Disallow | /adm |
Disallow | /cache |
Disallow | /docs |
Disallow | /help |
Disallow | /files |
Disallow | /includes |
Disallow | /install |
Disallow | /language |
Disallow | /store |
Disallow | /app.php |
Disallow | /common.php |
Disallow | /config.php |
Disallow | /cron.php |
Disallow | /faq.php |
Disallow | /feed |
Disallow | /mcp.php |
Disallow | /posting.php |
Disallow | /report.php |
Disallow | /ucp.php |
Disallow | /viewonline.php |
Disallow | /index.php |
Disallow | /memberlist.php |
Disallow | /search.php |
Disallow | /viewtopic.php/*viewtopic.php?* |
Disallow | /viewtopic.php?p=* |
Disallow | /viewtopic.php?f=*&t=* |
Disallow | /viewtopic.php?t=*p=* |
Disallow | /viewtopic.php?f=*p=* |
Disallow | /viewtopic.php?t=*&start=0$ |
Disallow | /viewtopic.php?f=*&start=0$ |
Disallow | /viewtopic.php?*&view=viewpoll |
Disallow | /thankslist |
Disallow | /*%26st%3D* |
Disallow | /*%26sk%3D* |
Disallow | /*%26sd%3D* |
Disallow | /*%26hilit%3D* |
Disallow | /*%26view%3D* |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://vopros-deti.ru/sitemap.xml |