hindi.moneycontrol.com
robots.txt

Robots Exclusion Standard data for hindi.moneycontrol.com

Resource Scan

Scan Details

Site Domain hindi.moneycontrol.com
Base Domain moneycontrol.com
Scan Status Ok
Last Scan2024-09-17T09:32:32+00:00
Next Scan 2024-10-01T09:32:32+00:00

Last Scan

Scanned2024-09-17T09:32:32+00:00
URL https://hindi.moneycontrol.com/robots.txt
Domain IPs 23.54.58.50, 2600:1417:3f:791::3379, 2600:1417:3f:793::3379, 2600:1417:3f:794::3379, 2600:1417:3f:79b::3379, 2600:1417:3f:79f::3379
Response IP 23.54.58.50
Found Yes
Hash 28a2139663f557f17839600abfdf2394b8afe2e73e1a7e3f42b982e73c76ad26
SimHash 6816d954a9a3

Groups

*

Rule Path
Allow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

mazbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://hindi.moneycontrol.com/sitemap/news_sitemap.xml
sitemap https://hindi.moneycontrol.com/category-sitemap.xml
sitemap https://hindi.moneycontrol.com/sitemap/webstories_sitemap.xml
sitemap https://hindi.moneycontrol.com/index-sitemap-2024.xml