news.ftv.com.tw
robots.txt

Robots Exclusion Standard data for news.ftv.com.tw

Resource Scan

Scan Details

Site Domain news.ftv.com.tw
Base Domain ftv.com.tw
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-08T16:09:57+00:00
Next Scan 2024-12-07T16:09:57+00:00

Last Successful Scan

Scanned2022-07-26T05:42:38+00:00
URL https://news.ftv.com.tw/robots.txt
Redirect https://www.ftvnews.com.tw/robots.txt
Redirect Domain www.ftvnews.com.tw
Redirect Base ftvnews.com.tw
Response IP 52.187.17.126
Found Yes
Hash 66dc55da167f7aaa7c975f7b3d10cfc24aa50fec60be4dc87f83267a71e39786
SimHash 024e51504d11

Groups

*

Rule Path
Allow /

petalbot

Rule Path
Disallow /

w2gbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ftvnews.com.tw/sitemap/sitemap.xml

Comments

  • User-agent: SearchmetricsBot
  • Disallow: /