valueresearchonline.com
robots.txt
Robots Exclusion Standard data for valueresearchonline.com
Resource Scan
Scan Details
Site Domain | valueresearchonline.com |
Base Domain | valueresearchonline.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-18T16:36:52+00:00 |
Next Scan | 2024-07-02T16:36:52+00:00 |
Last Successful Scan
Scanned | 2024-04-08T16:35:10+00:00 |
URL | https://valueresearchonline.com/robots.txt |
Redirect | https://www.valueresearchonline.com/robots.txt |
Redirect Domain | www.valueresearchonline.com |
Redirect Base | valueresearchonline.com |
Domain IPs | 104.22.42.156, 104.22.43.156, 172.67.36.128, 2606:4700:10::6816:2a9c, 2606:4700:10::6816:2b9c, 2606:4700:10::ac43:2480 |
Redirect IPs | 104.22.42.156, 104.22.43.156, 172.67.36.128, 2606:4700:10::6816:2a9c, 2606:4700:10::6816:2b9c, 2606:4700:10::ac43:2480 |
Response IP | 104.22.42.156 |
Found | Yes |
Hash | 3054dfa601b2830fcebe1629e63a633f0a6dbb317ebb2c1fb2496049e44a02cb |
SimHash | 29489b2242b2 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /downloads/stock-announcement/ |
Disallow | /downloads/annual-report/ |
Disallow | /downloads/fund-card/ |
Disallow | /downloads/stock-report/ |
Disallow | /mint/ |
Disallow | /amfi/ |
Disallow | /icici/ |
Disallow | /kustard/ |
Disallow | /ads/ |
Disallow | /funds/*/*xxx*/ |
Disallow | /stocks/*/*xxx*/ |
Disallow | /stories/*/*xxx*/ |
Disallow | /funds/*/*-bf-*/ |
Disallow | /stocks/*/*-bf-*/ |
Disallow | /stories/*/*-bf-*/ |
Disallow | /funds/*/bf-*/ |
Disallow | /stocks/*/bf-*/ |
Disallow | /stories/*/bf-*/ |
Disallow | /asts/img/opt-loading-login-img.webm |
Disallow | /asts/img/opt-loading-login-img.mp4 |
Other Records
Field | Value |
---|---|
sitemap | https://www.valueresearchonline.com/site-map/news.xml |
sitemap | https://www.valueresearchonline.com/site-map/web-stories-1.xml |
sitemap | https://www.valueresearchonline.com/site-map/index.xml |