malayalam.oneindia.com
robots.txt

Robots Exclusion Standard data for malayalam.oneindia.com

Resource Scan

Scan Details

Site Domain malayalam.oneindia.com
Base Domain oneindia.com
Scan Status Ok
Last Scan2024-11-14T07:40:38+00:00
Next Scan 2024-12-14T07:40:38+00:00

Last Scan

Scanned2024-11-14T07:40:38+00:00
URL https://malayalam.oneindia.com/robots.txt
Domain IPs 104.18.43.175, 172.64.144.81, 2606:4700:4400::6812:2baf, 2606:4700:4400::ac40:9051
Response IP 172.64.144.81
Found Yes
Hash c153b06e43222f41ce6f5f87b8fe5d3c50e68b573952965dc25239ebb0c9c643
SimHash eb66dfc005d0

Groups

*

Rule Path
Allow /
Disallow /404.html
Disallow /temp/
Disallow /videos/searchby/
Disallow /*?content_id=*
Disallow /search.html?topic*
Disallow /search/
Disallow /scripts/
Disallow /*vjsembed*
Disallow /*watch*
Disallow /search/results.html*
Disallow /*?page*
Disallow /*?story*
Disallow /amphtml/topic/*
Disallow /amphtml/*/articlecontent-pf*
Disallow /common/mykhel_block/*
Disallow /videos/amphtml/
Disallow /videos/amphtml/*
Disallow /videos/search-videos/
Disallow /videos/homepagewidget/*
Disallow /videos/tagfeeds/*
Disallow /videos/locationfeeds_es/*

mediapartners-google

Rule Path
Allow /

googlebot-news

Rule Path
Allow /
Disallow /jokes/
Disallow /partner-content/

grapeshot

Rule Path
Disallow

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://malayalam.oneindia.com/sitemap_news.xml
sitemap https://malayalam.oneindia.com/sitemap-2024-index.xml
sitemap https://malayalam.oneindia.com/sitemap-2023-index.xml
sitemap https://malayalam.oneindia.com/sitemap-2022-index.xml
sitemap https://malayalam.oneindia.com/sitemap-categories.xml
sitemap https://malayalam.oneindia.com/sitemap-webstories-index.xml
sitemap https://malayalam.oneindia.com/sitemap_cities.xml
sitemap https://malayalam.oneindia.com/sitemap-videos-index.xml
sitemap https://malayalam.oneindia.com/sitemap-images-index.xml