malayalam.news18.com
robots.txt
Robots Exclusion Standard data for malayalam.news18.com
Resource Scan
Scan Details
| Site Domain | malayalam.news18.com |
| Base Domain | news18.com |
| Scan Status | Ok |
| Last Scan | 2024-09-24T10:17:14+00:00 |
| Next Scan | 2024-10-08T10:17:14+00:00 |
Last Scan
| Scanned | 2024-09-24T10:17:14+00:00 |
| URL | https://malayalam.news18.com/robots.txt |
| Domain IPs | 23.36.49.159, 2600:1413:b000:389::3393, 2600:1413:b000:398::3393 |
| Response IP | 23.54.57.187 |
| Found | Yes |
| Hash | 3d8b93d0e759630a021d127eeed0a41f4905c5bb937e9146cb924eef1911fa36 |
| SimHash | dc25ea668b15 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /events/general-election-2019/ |
| Disallow | /uc/ |
| Disallow | /uc-election-widget/ |
| Disallow | /tag/*/page-*/ |
| Disallow | /tag/*/photogallery/* |
| Disallow | /tag/*/videos/* |
| Disallow | /tag/*/news/* |
| Disallow | /amp/tag/*/news/ |
| Disallow | /amp/tag/*/photogallery/ |
| Disallow | /amp/tag/*/videos/ |
| Disallow | /amp/tag/*/buzz/ |
| Disallow | /amp/tag/*/career/ |
| Disallow | /amp/tag/*/india/ |
| Disallow | /amp/tag/*/opinion/ |
| Disallow | /amp/tag/*/kerala/ |
| Disallow | /amp/tag/*/india-china/ |
| Disallow | /amp/tag/*/crime/ |
| Disallow | /amp/tag/*/gulf/ |
| Disallow | /amp/tag/*/sports/ |
| Disallow | /amp/tag/*/life/ |
| Disallow | /amp/tag/*/money/ |
| Disallow | /amp/tag/*/explained/ |
| Disallow | /amp/tag/*/tag/*/ |
| Disallow | /videos/*page-*page-*/page-*/tag/*/ |
| Disallow | /assembly-elections-*/%3Astate_slug%3A/* |
| Disallow | /assembly-elections-*/*/*/* |
| Disallow | */News18_Malayalam_WAP/* |
| Disallow | */*.html/page-*/tag/*/ |
| Disallow | /ampnews/*/*.html/page-*/ |
| Disallow | */lok-sabha-election-2019/* |
| Disallow | */page-*/tag/*/ |
| Disallow | */*/*/page-*/page*/ |
| Disallow | */assembly-election-2019/*.html/tag/*/ |
| Disallow | /amp/*/assembly-election-2019/*.html |
| Disallow | /amp/*/*/*/page-* |
| Disallow | /ampvideos/*/*.html/page-*/ |
| Disallow | /scorecard/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://malayalam.news18.com/commonfeeds/v1/mal/sitemap/today |
| sitemap | https://malayalam.news18.com/commonfeeds/v1/mal/sitemap-index.xml |
| sitemap | https://malayalam.news18.com/commonfeeds/v1/mal/sitemap/google-news.xml |
| sitemap | https://malayalam.news18.com/commonfeeds/v1/mal/sitemap-image-index.xml |
| sitemap | https://malayalam.news18.com/commonfeeds/v1/mal/sitemap-video-index.xml |
| sitemap | https://malayalam.news18.com/commonfeeds/v1/mal/sitemap/webstories-sitemap-index.xml |