ftvnews-front-ftvnews-fronttest.azurewebsites.net
robots.txt

Resource Scan

Scan Details

Site Domain ftvnews-front-ftvnews-fronttest.azurewebsites.net
Base Domain ftvnews-front-ftvnews-fronttest.azurewebsites.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-05T06:23:56+00:00
Next Scan 2024-06-19T06:23:56+00:00

Last Successful Scan

Scanned2024-05-21T02:11:12+00:00
URL https://ftvnews-front-ftvnews-fronttest.azurewebsites.net/robots.txt
Domain IPs 52.187.17.126
Response IP 52.187.17.126
Found Yes
Hash 2c88f2c01dcbf2cbf71d453d608b121cb3aae6745aeabbde194265e0044f79f5
SimHash 824e5140c811

Groups

*
petalbot

Rule Path
Disallow /

w2gbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ftvnews.com.tw/sitemap/sitemap.xml

Comments

  • User-agent: SearchmetricsBot
  • Disallow: /