jyes.com.tw
robots.txt

Robots Exclusion Standard data for jyes.com.tw

Resource Scan

Scan Details

Site Domain jyes.com.tw
Base Domain jyes.com.tw
Scan Status Ok
Last Scan2024-07-31T06:41:17+00:00
Next Scan 2024-08-30T06:41:17+00:00

Last Scan

Scanned2024-07-31T06:41:17+00:00
URL https://jyes.com.tw/robots.txt
Redirect https://www.jyes.com.tw/robots.txt
Redirect Domain www.jyes.com.tw
Redirect Base jyes.com.tw
Domain IPs 15.235.162.96
Redirect IPs 15.235.162.96
Response IP 15.235.162.96
Found Yes
Hash 5cc8b91afd57bd0aeddf2234dd68f19ee8c3a63ee8672959378f732c60679303
SimHash d35fc8616f72

Groups

yisouspider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.jyes.com.tw/sitemap.xml

Comments

  • http://www.majestic12.co.uk/projects/dsearch/mj12bot.php
  • "TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html)"
  • "netEstate NE Crawler (+http://www.sengine.info/)"