smartinvestor.business-standard.com
robots.txt
Robots Exclusion Standard data for smartinvestor.business-standard.com
Resource Scan
Scan Details
| Site Domain | smartinvestor.business-standard.com |
| Base Domain | business-standard.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-06-25T08:25:22+00:00 |
| Next Scan | 2024-09-23T08:25:22+00:00 |
Last Successful Scan
| Scanned | 2023-02-09T02:17:46+00:00 |
| URL | http://smartinvestor.business-standard.com/robots.txt |
| Domain IPs | 52.66.106.116 |
| Response IP | 52.66.106.116 |
| Found | Yes |
| Hash | 21dca530ba2c85d778effab2b81e7d6e473d31f701b164ab5e26d4c2d3d50124 |
| SimHash | 116217940555 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /g1.php |
| Disallow | /india/backend/ |
| Disallow | /ads/ |
| Disallow | /backend/ |
| Disallow | /smartportfolio/images/user_img |
| Disallow | /smartportfolio/ |
| Disallow | /emag/ |
| Disallow | /mf/ |
| Disallow | /feedback/ |
| Disallow | /community/ |
| Disallow | /reebokoffer/ |
| Disallow | /special/ |
| Disallow | /budget/ |
| Disallow | /market/toolsChartCorn.php |
| Disallow | /commodities/ |
| Disallow | /company/ |
| Disallow | /pf/ |
| Disallow | /common/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://smartinvestor.business-standard.com/Sitemap.xml |
| sitemap | https://smartinvestor.business-standard.com/Sitemap-news.xml |