livemint.com
robots.txt

Robots Exclusion Standard data for livemint.com

Resource Scan

Scan Details

Site Domain livemint.com
Base Domain livemint.com
Scan Status Ok
Last Scan2024-04-21T21:54:51+00:00
Next Scan 2024-04-28T21:54:51+00:00

Last Scan

Scanned2024-04-21T21:54:51+00:00
URL https://livemint.com/robots.txt
Redirect https://www.livemint.com/robots.txt
Redirect Domain www.livemint.com
Redirect Base livemint.com
Domain IPs 2600:1413:b000:396::1833, 2600:1413:b000:39c::1833, 96.16.117.137
Redirect IPs 23.52.113.224, 2600:1413:1:598::1833, 2600:1413:1:59e::1833
Response IP 23.54.58.39
Found Yes
Hash 01dccfc348b106efd4bf125319a3f27548738c4d07dfb275b4a473500bab2263
SimHash a8009b77d750

Groups

*

Rule Path
Allow /
Disallow /Object/DA0yZYT1mFs1NaiDueSvBP/dashboard.html
Disallow /Object/FjDTkjBmbjPylZPtjdfocJ/dashboard.html
Disallow /Object/NRItzKXDWQ01wSRYBec2bK/approve-subscribers.html
Disallow /Object/5FRQEn6WdzPZx95TNmgRgJ/submit-approved-subscribers.html
Disallow /queryResult/DashBoardResult
Disallow /Politics/qGhqEUxkwY1XCf44StpdPM/Asaram-Bapu-From-building-an-empire-of-Rs-10000-crore-to-b.html
Disallow /Politics/qGhqEUxkwY1XCf44StpdPM/Asaram-Bapu-From-building-an-empire-of-Rs-10000-crore-to-b.html?facet=amp&utm_source=googleamp&utm_medium=referral&utm_campaign=googleamp
Disallow /*?type=card
Disallow /*?type=list
Disallow /*?type=collection
Disallow /homesubscribed
Disallow /quick-reads/*.html
Disallow /listing/topic/*
Disallow /fullStory/*
Disallow /listing/video/*
Disallow /listing/gallery/*
Disallow */market/watchlist*
Disallow /brand-stories/international/*

Other Records

Field Value
sitemap https://www.livemint.com/sitemap/yesterday.xml
sitemap https://www.livemint.com/sitemap/today.xml
sitemap https://www.livemint.com/lm-section/sitemap.xml