indiaherald.com
robots.txt
Robots Exclusion Standard data for indiaherald.com
Resource Scan
Scan Details
| Site Domain | indiaherald.com |
| Base Domain | indiaherald.com |
| Scan Status | Ok |
| Last Scan | 2024-09-27T04:50:00+00:00 |
| Next Scan | 2024-10-04T04:50:00+00:00 |
Last Scan
| Scanned | 2024-09-27T04:50:00+00:00 |
| URL | https://indiaherald.com/robots.txt |
| Redirect | https://www.indiaherald.com/robots.txt |
| Redirect Domain | www.indiaherald.com |
| Redirect Base | indiaherald.com |
| Domain IPs | 104.22.2.54, 104.22.3.54, 172.67.21.145, 2606:4700:10::6816:236, 2606:4700:10::6816:336, 2606:4700:10::ac43:1591 |
| Redirect IPs | 104.22.2.54, 104.22.3.54, 172.67.21.145, 2606:4700:10::6816:236, 2606:4700:10::6816:336, 2606:4700:10::ac43:1591 |
| Response IP | 172.67.21.145 |
| Found | Yes |
| Hash | 028198a5e2625a72a5633d9ab175b05728e654201496b58afa4025cf217fe01f |
| SimHash | 4d54c71576f1 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /75242261 |
| Disallow | /pub |
| Disallow | /new |
| Disallow | /edit/ |
| Disallow | /cinema |
| Disallow | /Cinema |
| Allow | /api/grd |
| Allow | /api/cachedapi |
| Allow | /api/gabyuid |
| Allow | /api/gad |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /75242261 |
| Disallow | /pub |
| Disallow | /new |
| Disallow | /edit/ |
| Disallow | /cinema |
| Disallow | /Cinema |
| Allow | /api/grd |
| Allow | /api/cachedapi |
| Allow | /api/gabyuid |
| Allow | /api/gad |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /75242261 |
| Disallow | /pub |
| Disallow | /new |
| Disallow | /edit/ |
| Disallow | /cinema |
| Disallow | /Cinema |
| Allow | /api/grd |
| Allow | /api/cachedapi |
| Allow | /api/gabyuid |
| Allow | /api/gad |
googlebot-news
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /75242261 |
| Disallow | /pub |
| Disallow | /new |
| Disallow | /edit/ |
| Disallow | /cinema |
| Disallow | /Cinema |
| Allow | /api/grd |
| Allow | /api/cachedapi |
| Allow | /api/gabyuid |
| Allow | /api/gad |
bingbot
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /75242261 |
| Disallow | /pub |
| Disallow | /new |
| Disallow | /edit/ |
| Disallow | /cinema |
| Disallow | /Cinema |
| Allow | /api/grd |
| Allow | /api/cachedapi |
| Allow | /api/gabyuid |
| Allow | /api/gad |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /75242261 |
| Disallow | /pub |
| Disallow | /new |
| Disallow | /edit/ |
| Disallow | /cinema |
| Disallow | /Cinema |
| Allow | /api/grd |
| Allow | /api/cachedapi |
| Allow | /api/gabyuid |
| Allow | /api/gad |
*
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /75242261 |
| Disallow | /pub |
| Disallow | /new |
| Disallow | /edit/ |
| Disallow | /cinema |
| Disallow | /Cinema |
| Disallow | /Movies/ViewArticle/146390/Regina-s-Too-Revealing-Night-Gown-becomes-Talk-of-Bollywood |
| Allow | /api/grd |
| Allow | /api/cachedapi |
| Allow | /api/gabyuid |
| Allow | /api/gad |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.indiaherald.com/info/latestsitemap |
| sitemap | https://www.indiaherald.com/info/latestsitemap/telugu |
| sitemap | https://www.indiaherald.com/info/imagesitemap |
| sitemap | https://www.indiaherald.com/info/videositemap |