assam.news18.com
robots.txt
Robots Exclusion Standard data for assam.news18.com
Resource Scan
Scan Details
| Site Domain | assam.news18.com |
| Base Domain | news18.com |
| Scan Status | Ok |
| Last Scan | 2024-10-19T05:27:18+00:00 |
| Next Scan | 2024-11-02T05:27:18+00:00 |
Last Scan
| Scanned | 2024-10-19T05:27:18+00:00 |
| URL | https://assam.news18.com/robots.txt |
| Domain IPs | 23.36.50.99, 2600:1413:b000:38c::3379, 2600:1413:b000:390::3379 |
| Response IP | 23.54.58.50 |
| Found | Yes |
| Hash | 7f15f46ce928ccb6e96ffeb72da4476f2906534a599309a5f5ade91100566776 |
| SimHash | ce09cb79c5c7 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /assam-assembly-election-2021/*/$ |
| Disallow | /amp/assam-assembly-election-2021/*/$ |
| Disallow | /assam-assembly-election-*page-*$ |
| Disallow | /photogallery/*/page-*/$ |
| Disallow | /byline/*/page-*/$ |
| Disallow | /photogallery/*/byline/*.html$ |
| Disallow | /category/*/page-*/$ |
| Disallow | */News18_Assam/News18_Assam_ROS/* |
| Disallow | /news/*/byline/*.html$ |
| Disallow | /scorecard/ |
| Disallow | /tag/*/news |
| Disallow | /cricketnext/ |
| Disallow | /*/page-*/ |
| Disallow | /tag/*/photogallery |
| Disallow | /tag/*/videos |
| Disallow | /embed/ |
| Disallow | /*1page-1page-1 |
| Disallow | /articles-sitemap |
| Disallow | /image-sitemap |
| Disallow | /videos-sitemap |
| Disallow | /assembly-elections-2022/ |
| Disallow | /topics/assembly-elections-2022/ |
| Disallow | /assam-assembly-elections-2021/ |
| Disallow | /category/ |
| Disallow | /1 |
| Disallow | /2 |
| Disallow | /3 |
| Disallow | /4 |
| Disallow | /5 |
| Disallow | /6 |
| Disallow | /7 |
| Disallow | /8 |
| Disallow | /9 |
| Disallow | /0 |
| Disallow | /*/undefined/ |
| Disallow | /coronavirus-sharechat/ |
| Disallow | /amp/tag/*/news/ |
| Disallow | /*html?pv_candidate= |
| Disallow | /notfound/ |
| Disallow | /notifications/ |
| Disallow | /assembly-election-2021/ |
| Disallow | /amp/tag/*/videos/ |
| Disallow | /amp/tag/*/photogallery/ |
| Disallow | /photogallery/photogallery/ |
| Disallow | /amp/photogallery/photogallery/ |
| Disallow | /board-results-pubstack/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://assam.news18.com/commonfeeds/v1/asm/sitemap/today |
| sitemap | https://assam.news18.com/commonfeeds/v1/asm/sitemap-index.xml |
| sitemap | https://assam.news18.com/commonfeeds/v1/asm/sitemap/google-news.xml |
| sitemap | https://assam.news18.com/commonfeeds/v1/asm/sitemap-image-index.xml |
| sitemap | https://assam.news18.com/commonfeeds/v1/asm/sitemap-video-index.xml |
| sitemap | https://assam.news18.com/commonfeeds/v1/asm/sitemap/webstories-sitemap-index.xml |