businesstoday.in
robots.txt

Robots Exclusion Standard data for businesstoday.in

Resource Scan

Scan Details

Site Domain businesstoday.in
Base Domain businesstoday.in
Scan Status Ok
Last Scan2024-09-25T18:07:14+00:00
Next Scan 2024-10-02T18:07:14+00:00

Last Scan

Scanned2024-09-25T18:07:14+00:00
URL https://businesstoday.in/robots.txt
Redirect https://www.businesstoday.in/robots.txt
Redirect Domain www.businesstoday.in
Redirect Base businesstoday.in
Domain IPs 184.87.193.82, 184.87.193.83, 2600:1417:5e::1731:3c33, 2600:1417:5e::1731:3c3a, 2600:1417:5e::adde:9431
Redirect IPs 184.87.193.82, 184.87.193.83, 2600:1413:b000:13::b857:c188, 2600:1413:b000:13::b857:c1a1
Response IP 23.45.207.178
Found Yes
Hash c5cf7b3b76243c7d6dc1c8e00e08aa7750b4b003f2275d1d3a5a07e45bcc6232
SimHash e10e141695b9

Groups

*

Rule Path
Allow /
Disallow /topic/*
Disallow /prnewswire/
Disallow /sitetakeoverad
Disallow /visualstories/preview.php?*

googlebot-news

Rule Path
Disallow /impact-feature/
Disallow /visualstories/preview.php?*
Disallow /sitetakeoverad

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.businesstoday.in/rssfeeds/sitemap.xml
sitemap https://www.businesstoday.in/rssfeeds/news-sitemap.xml
sitemap https://www.businesstoday.in/rssfeeds/date-wise-stories-sitemap.xml
sitemap https://www.businesstoday.in/visualstories/webstories-sitemap.xml