malayalam.oneindia.com
robots.txt
Robots Exclusion Standard data for malayalam.oneindia.com
Resource Scan
Scan Details
Site Domain | malayalam.oneindia.com |
Base Domain | oneindia.com |
Scan Status | Ok |
Last Scan | 2024-11-14T07:40:38+00:00 |
Next Scan | 2024-12-14T07:40:38+00:00 |
Last Scan
Scanned | 2024-11-14T07:40:38+00:00 |
URL | https://malayalam.oneindia.com/robots.txt |
Domain IPs | 104.18.43.175, 172.64.144.81, 2606:4700:4400::6812:2baf, 2606:4700:4400::ac40:9051 |
Response IP | 172.64.144.81 |
Found | Yes |
Hash | c153b06e43222f41ce6f5f87b8fe5d3c50e68b573952965dc25239ebb0c9c643 |
SimHash | eb66dfc005d0 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /404.html |
Disallow | /temp/ |
Disallow | /videos/searchby/ |
Disallow | /*?content_id=* |
Disallow | /search.html?topic* |
Disallow | /search/ |
Disallow | /scripts/ |
Disallow | /*vjsembed* |
Disallow | /*watch* |
Disallow | /search/results.html* |
Disallow | /*?page* |
Disallow | /*?story* |
Disallow | /amphtml/topic/* |
Disallow | /amphtml/*/articlecontent-pf* |
Disallow | /common/mykhel_block/* |
Disallow | /videos/amphtml/ |
Disallow | /videos/amphtml/* |
Disallow | /videos/search-videos/ |
Disallow | /videos/homepagewidget/* |
Disallow | /videos/tagfeeds/* |
Disallow | /videos/locationfeeds_es/* |
Other Records
Field | Value |
---|---|
sitemap | https://malayalam.oneindia.com/sitemap_news.xml |
sitemap | https://malayalam.oneindia.com/sitemap-2024-index.xml |
sitemap | https://malayalam.oneindia.com/sitemap-2023-index.xml |
sitemap | https://malayalam.oneindia.com/sitemap-2022-index.xml |
sitemap | https://malayalam.oneindia.com/sitemap-categories.xml |
sitemap | https://malayalam.oneindia.com/sitemap-webstories-index.xml |
sitemap | https://malayalam.oneindia.com/sitemap_cities.xml |
sitemap | https://malayalam.oneindia.com/sitemap-videos-index.xml |
sitemap | https://malayalam.oneindia.com/sitemap-images-index.xml |