moneycontrol.com
robots.txt
Robots Exclusion Standard data for moneycontrol.com
Resource Scan
Scan Details
| Site Domain | moneycontrol.com |
| Base Domain | moneycontrol.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-02T23:22:42+00:00 |
| Next Scan | 2024-05-16T23:22:42+00:00 |
Last Successful Scan
| Scanned | 2024-04-17T23:22:22+00:00 |
| URL | https://moneycontrol.com/robots.txt |
| Redirect | https://www.moneycontrol.com/robots.txt |
| Redirect Domain | www.moneycontrol.com |
| Redirect Base | moneycontrol.com |
| Domain IPs | 125.56.219.41, 2600:1413:1::48f7:7fd9, 2600:1413:1::48f7:7ffa, 96.17.72.73 |
| Redirect IPs | 184.26.21.115, 2600:1413:b000:389::3393, 2600:1413:b000:39a::3393 |
| Response IP | 23.54.57.187 |
| Found | Yes |
| Hash | 0b0a70c79dc5710cd7cc300a092a6194ca5bce6ee583ec8ccac499a7abcc67c7 |
| SimHash | 3c0fd85021c7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /intuit/promo/ |
| Disallow | /network18/index.html |
| Disallow | /budget2013/live-union-budget.html |
| Disallow | /1039154/ |
| Disallow | /tech_charts/ |
| Disallow | /livefeed_pdf/ |
| Disallow | /profile/ |
| Disallow | /pdffiles/ |
| Disallow | /news_html_files/ |
| Disallow | /markets/market-stats/the-great-sensex-challenge/ |
| Disallow | /markets/market-stats/the-great-sensex-challenge/winners/ |
| Disallow | /printpage/ |
| Disallow | /news/printpage/ |
| Disallow | /news/business/economy/exclusive-india-exported-nearly-9300-metric-tonnes-of-oxygen-in-fy21-as-pandemic-rolled-on-6792711.html |
| Disallow | /open_in_app.php |
| Disallow | /*/page-*/ |
| Disallow | /mc/widget/ |
| Disallow | /react-asset/ |
| Disallow | /techmvc/mc_apis/ |
| Disallow | /commonfiles/font/ |
| Disallow | /news/widget/ |
| Disallow | /news18/stocks/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.moneycontrol.com/mccode/sitemap/stocks_technical_analysis.xml |
| sitemap | https://www.moneycontrol.com/news/news-sitemap.xml |
| sitemap | https://www.moneycontrol.com/sitemap/category-sitemap.xml |
| sitemap | https://www.moneycontrol.com/news/webstories-sitemap.xml |
| sitemap | https://www.moneycontrol.com/news/index-sitemap-2023.xml |