blogs.livemint.com
robots.txt
Robots Exclusion Standard data for blogs.livemint.com
Resource Scan
Scan Details
| Site Domain | blogs.livemint.com |
| Base Domain | livemint.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-24T13:57:28+00:00 |
| Next Scan | 2024-12-23T13:57:28+00:00 |
Last Successful Scan
| Scanned | 2024-05-28T13:23:16+00:00 |
| URL | http://blogs.livemint.com/robots.txt |
| Redirect | https://www.livemint.com/robots.txt |
| Redirect Domain | www.livemint.com |
| Redirect Base | livemint.com |
| Domain IPs | 52.74.17.139 |
| Redirect IPs | 104.119.106.35, 2600:1417:3f:789::1833, 2600:1417:3f:795::1833 |
| Response IP | 23.54.58.39 |
| Found | Yes |
| Hash | 01dccfc348b106efd4bf125319a3f27548738c4d07dfb275b4a473500bab2263 |
| SimHash | a8009b77d750 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /Object/DA0yZYT1mFs1NaiDueSvBP/dashboard.html |
| Disallow | /Object/FjDTkjBmbjPylZPtjdfocJ/dashboard.html |
| Disallow | /Object/NRItzKXDWQ01wSRYBec2bK/approve-subscribers.html |
| Disallow | /Object/5FRQEn6WdzPZx95TNmgRgJ/submit-approved-subscribers.html |
| Disallow | /queryResult/DashBoardResult |
| Disallow | /Politics/qGhqEUxkwY1XCf44StpdPM/Asaram-Bapu-From-building-an-empire-of-Rs-10000-crore-to-b.html |
| Disallow | /Politics/qGhqEUxkwY1XCf44StpdPM/Asaram-Bapu-From-building-an-empire-of-Rs-10000-crore-to-b.html?facet=amp&utm_source=googleamp&utm_medium=referral&utm_campaign=googleamp |
| Disallow | /*?type=card |
| Disallow | /*?type=list |
| Disallow | /*?type=collection |
| Disallow | /homesubscribed |
| Disallow | /quick-reads/*.html |
| Disallow | /listing/topic/* |
| Disallow | /fullStory/* |
| Disallow | /listing/video/* |
| Disallow | /listing/gallery/* |
| Disallow | */market/watchlist* |
| Disallow | /brand-stories/international/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.livemint.com/sitemap/yesterday.xml |
| sitemap | https://www.livemint.com/sitemap/today.xml |
| sitemap | https://www.livemint.com/lm-section/sitemap.xml |