Log In Sign Up

www2.njss.info
robots.txt

Robots Exclusion Standard data for www2.njss.info

Resource Scan

Scan Details

Site Domain www2.njss.info
Base Domain njss.info
Scan Status Ok
Last Scan2024-10-19T16:36:58+00:00
Next Scan 2024-11-18T16:36:58+00:00

Last Scan

Scanned2024-10-19T16:36:58+00:00
URL https://www2.njss.info/robots.txt
Domain IPs 13.33.88.114, 13.33.88.3, 13.33.88.35, 13.33.88.86
Response IP 13.33.88.86
Found Yes
Hash f09e3a76b07f2d1cdbf1617724756bced47350994cda5be1c82e8fdfb354d839
SimHash 5b1efa0449d3

Groups

*

Rule Path
Disallow /users/login?*
Disallow /competitors/view/c3ksjgh72avemdnbhp0g
Disallow /competitors/view/c3nsf32or2b4fpa8phu0
Disallow /competitors/view/c3nihr9s1e2audqm2fa0
Disallow /qualifications/view/

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

baidumobaider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

speedy

Rule Path
Disallow /

yeti

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

sitebot/0.1

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

holmes

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmedia

Rule Path
Disallow /

lexxebot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

sindicebot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www2.njss.info/sitemap_index.xml
Back to top

Comments

  • 除外するページ
  • パラメーター付きログインページ
  • 株式会社ユーキャップ
  • Rセキュリティ株式会社
  • 資格詳細ページ
  • 除外する検索bot
Back to top