telugu.news18.com
robots.txt
Robots Exclusion Standard data for telugu.news18.com
Resource Scan
Scan Details
| Site Domain | telugu.news18.com |
| Base Domain | news18.com |
| Scan Status | Ok |
| Last Scan | 2024-10-24T20:14:15+00:00 |
| Next Scan | 2024-11-07T20:14:15+00:00 |
Last Scan
| Scanned | 2024-10-24T20:14:15+00:00 |
| URL | https://telugu.news18.com/robots.txt |
| Domain IPs | 23.36.50.99, 2600:1413:b000:38c::3379, 2600:1413:b000:390::3379 |
| Response IP | 23.54.58.50 |
| Found | Yes |
| Hash | 5fbec5dda50ca82e3e3a0e89cc3d05ac02eee0acd4908f84f43b3cc1a2bcf9b5 |
| SimHash | 520675508d83 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /events/general-election-2019/ |
| Disallow | /uc/ |
| Disallow | /.well-known/ |
| Disallow | /uc-election-widget/ |
| Disallow | /mutual-funds/ |
| Disallow | /insurance/ |
| Disallow | /auto/ |
| Disallow | /tag/%*/ |
| Disallow | /tag/*/page-*/ |
| Disallow | /tag/*/photogallery/page-*/ |
| Disallow | /tag/*/videos/page-*/ |
| Disallow | /tag/*/news/page-*/ |
| Disallow | /amp/tag/%*/ |
| Disallow | /amp/tag/*/page-*/ |
| Disallow | /amp/tag/*/photogallery/page-*/ |
| Disallow | */ampnews/* |
| Disallow | */category$ |
| Disallow | /videopub/* |
| Disallow | /amp/agency/*/page-*/$ |
| Disallow | /agency/*/page-*/$ |
| Disallow | /*%3E |
| Disallow | /*%3C |
| Disallow | /*tag/*~ |
| Disallow | /*tag/*. |
| Disallow | /*tag/*%3A |
| Disallow | /byline/*page-* |
| Disallow | /byline/*--* |
| Disallow | /*tag/*%29 |
| Disallow | /*tag/*%28 |
| Disallow | /scorecard/ |
| Disallow | /news// |
| Disallow | /vod/ |
| Disallow | /embed/ |
| Disallow | /tag/*.* |
| Disallow | /amp/tag/*.* |
| Disallow | /*/page-*/ |
| Disallow | /amp/lok-sabha-election-2019/ |
| Disallow | /amp/*.htmlpage-*/ |
| Disallow | /videos/*.htmpage-*/ |
| Disallow | /lok-sabha-election-2019/ |
| Disallow | /amp/tag/*/videos/ |
| Disallow | /videos/*/page-*/ |
| Disallow | /tag/*/undefined/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://telugu.news18.com/commonfeeds/v1/tel/sitemap/today |
| sitemap | https://telugu.news18.com/commonfeeds/v1/tel/sitemap-index.xml |
| sitemap | https://telugu.news18.com/commonfeeds/v1/tel/sitemap/google-news.xml |
| sitemap | https://telugu.news18.com/commonfeeds/v1/tel/sitemap-video-index.xml |
| sitemap | https://telugu.news18.com/commonfeeds/v1/tel/sitemap/webstories-sitemap-index.xml |
| sitemap | https://telugu.news18.com/commonfeeds/v1/tel/sitemap-image-index.xml |
Warnings
- 11 invalid lines.