ndtvprofit.com
robots.txt

Robots Exclusion Standard data for ndtvprofit.com

Resource Scan

Scan Details

Site Domain ndtvprofit.com
Base Domain ndtvprofit.com
Scan Status Ok
Last Scan2024-09-21T22:03:54+00:00
Next Scan 2024-09-28T22:03:54+00:00

Last Scan

Scanned2024-09-21T22:03:54+00:00
URL https://ndtvprofit.com/robots.txt
Redirect https://www.ndtvprofit.com/robots.txt
Redirect Domain www.ndtvprofit.com
Redirect Base ndtvprofit.com
Domain IPs 23.20.179.164, 54.158.195.16
Redirect IPs 104.18.90.198, 104.18.91.198, 104.18.92.198, 104.18.93.198, 104.18.94.198, 2606:4700::6812:5ac6, 2606:4700::6812:5bc6, 2606:4700::6812:5cc6, 2606:4700::6812:5dc6, 2606:4700::6812:5ec6
Response IP 104.18.93.198
Found Yes
Hash a8ed3bd4346a3f0ad83bf0b0528a0f79159c65242da11fe6c612b92eafa29999
SimHash d02d1e406f12

Groups

*

Rule Path
Disallow /preview/story/
Disallow /story/*/element/*
Disallow /Stocks/Stock/CompareFullDetailsWeb
Disallow /Stocks/Price/PriceCompare
Disallow /Stock/ComparePeersWeb
Disallow /Stock/DashboardWeb
Disallow /Price/PriceMovingAvg
Disallow /Price/PriceDetails
Disallow /Shareholding/ShareholdingSnapshotCompare
Disallow /Price/PriceFundamental
Disallow /Stocks/CorporateAction/GetCorporateAction
Disallow /Stocks/Stock/PreviousDetailsWeb
Disallow /Stocks/ScoreCardV2/OverViewStockDNA
Disallow /Stocks/Returns/ReturnsDividend
Disallow /Stocks/Price/DeliveryVolumeDetails
Disallow /stocks/CorporateAction/GetCorporateActionFullDetails
Disallow /Stocks/Stock/DashboardMobileSeasonal
Disallow /Stocks/Shareholding/PromotersAnalysis
Disallow /Stocks/Shareholding/ShareHoldingAnalysisDetailsHighlights
Disallow /Stocks/Shareholding/ShareholdingSnapshot
Disallow /Stocks/ScoreCard/ScoreCardCompareWithOthers
Disallow /Stocks/Stock/DashboardMobile
Disallow /Stocks/Shareholding/ShareholdingDashBoard
Disallow /Stocks/Price/PriceMovement
Disallow /Stocks/Announcements/GetAnnouncementListing
Disallow /Stocks/ScoreCardV2/ValuationCompareWithPeers
Disallow /Stocks/Shareholding/ShareholdingDashBoardFull
Disallow /topic/*
Disallow /section/*
Disallow /widget/*

grapeshot

Rule Path
Disallow

gptbot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

ahref

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

claude

Rule Path
Disallow /

open ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ndtvprofit.com/news_sitemap.xml