vnav.vn
robots.txt
Robots Exclusion Standard data for vnav.vn
Resource Scan
Scan Details
Site Domain | vnav.vn |
Base Domain | vnav.vn |
Scan Status | Ok |
Last Scan | 2024-11-13T11:53:43+00:00 |
Next Scan | 2024-11-20T11:53:43+00:00 |
Last Scan
Scanned | 2024-11-13T11:53:43+00:00 |
URL | https://vnav.vn/robots.txt |
Domain IPs | 210.245.87.117 |
Response IP | 210.245.87.117 |
Found | Yes |
Hash | 609d8e7cb32aebfaadcf0dadb7fa63b11f3f345e7c0b3c99322fdaf17767e722 |
SimHash | 7efec6f027a9 |
Groups
proximic
proximic
bizinformation
blexbot
riddler
ltx71
magpie-crawler
grapeshot
grapeshotcrawler
gigablastopensource
bubing
linkdexbot
linkdexbot/2.2
seokicks
seokicks-robot
panscient.com
webdatastats
zoominfobot
megaindex.ru
megaindex.ru/2.0
yandex
yandexbot
yandexmobilebot
yandeximageresizer
coccocbot
coccocbot-web
coccocbot-image
yeti
baiduspider
sogou web spider
sogou
seekbot
seekport
seekport crawler
dotbot
dotbot
dotbot/1.1
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /account/ |
Disallow | /admin.php |
Disallow | /ajax/ |
Disallow | /conversations/ |
Disallow | /find-new/ |
Disallow | /forum/-/ |
Disallow | /forum |
Disallow | /forums/tweets/ |
Disallow | /goto/ |
Disallow | /help/ |
Disallow | /login/ |
Disallow | /lost-password/ |
Disallow | /misc/style?* |
Disallow | /misc/quick-navigation-menu?* |
Disallow | /online/ |
Disallow | /posts/ |
Disallow | /threads/tera-tweet-from-* |
Disallow | /credits/ |
Disallow | /register/ |
Disallow | /search/ |
Disallow | /members/ |
Disallow | /member-map/ |
Disallow | /attachments/ |
Disallow | /xfa-fss-purchase/ |
Disallow | /*/xfa-fss-purchase |
Allow | / |
Warnings
- 1 invalid line.