Log In Sign Up

hdl.co.jp
robots.txt

Robots Exclusion Standard data for hdl.co.jp

Resource Scan

Scan Details

Site Domain hdl.co.jp
Base Domain hdl.co.jp
Scan Status Ok
Last Scan2024-09-25T01:41:17+00:00
Next Scan 2024-10-25T01:41:17+00:00

Last Scan

Scanned2024-09-25T01:41:17+00:00
URL https://hdl.co.jp/robots.txt
Redirect https://www.hdl.co.jp/robots.txt
Redirect Domain www.hdl.co.jp
Redirect Base hdl.co.jp
Domain IPs 203.145.232.196
Redirect IPs 203.145.232.196
Response IP 203.145.232.196
Found Yes
Hash b8c94ebe1cb83f5f3e86f8e460a34c0f5e5cba52e4de8d3ee13e7a495189fb7a
SimHash 2d30bd2cc712

Groups

*

Rule Path
Disallow /hosyokitei.html
Disallow /spc/html/
Disallow /syobun/
Disallow /ftpdata/ftp/
Disallow /ftpdata/GHICOMM/
Disallow /en/spc/
Disallow /ftpdata/COMMN/
Disallow /ftpdata/fat-001/
Disallow /ftpdata/fat-002/
Disallow /ftpdata/fat-003/
Disallow /ftpdata/fat-004/
Disallow /ftpdata/fat-005/
Disallow /ftpdata/fat-006/
Disallow /ftpdata/catalog/
Disallow /files2/
Disallow /Home/
Disallow /cgi-bin/
Disallow /temp/
Disallow /bmp/
Disallow /book/
Disallow /pdf/
Disallow /tif/
Disallow /tuhan/
Disallow /oldrt/
Disallow /olddata/
Disallow /TNJ/
Disallow /GHI/
Disallow /CSP/
Disallow /XSP/
Disallow /pic/
Disallow /pic0/

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

swebot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.hdl.co.jp/sitemap.xml
Back to top

Comments

  • USA Alexa : alexa.com/
  • China Baidu : www.baidu.com, www.baidu.jp
  • China Baidu : www.baidu.com, www.baidu.jp
  • China Yodao : www.yodao.com
  • Korea Naver : www.naver.com 29/Mar/2007~
  • Korea Naver : www.naver.com ~26/Mar/2007?
  • swebot.net
Back to top