oneindia.in
robots.txt
Robots Exclusion Standard data for oneindia.in
Resource Scan
Scan Details
| Site Domain | oneindia.in |
| Base Domain | oneindia.in |
| Scan Status | Ok |
| Last Scan | 2024-11-12T05:58:22+00:00 |
| Next Scan | 2024-11-19T05:58:22+00:00 |
Last Scan
| Scanned | 2024-11-12T05:58:22+00:00 |
| URL | https://oneindia.in/robots.txt |
| Redirect | https://www.oneindia.com/robots.txt |
| Redirect Domain | www.oneindia.com |
| Redirect Base | oneindia.com |
| Domain IPs | 67.205.122.165 |
| Redirect IPs | 104.18.43.175, 172.64.144.81, 2606:4700:4400::6812:2baf, 2606:4700:4400::ac40:9051 |
| Response IP | 172.64.144.81 |
| Found | Yes |
| Hash | 0b071cb31d96a50ab0248179e7cadde7f97c52ed820162e3c9e8d4d4cf101a44 |
| SimHash | e926df4055d5 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /*.js* |
| Allow | /*.css* |
| Disallow | /comment/ |
| Disallow | /shorts/ |
| Disallow | /temp/ |
| Disallow | /amphtml/temp/ |
| Disallow | /test/ |
| Disallow | /newsletter/ |
| Disallow | /*news-business-index*.html |
| Disallow | /*news-sports-index*.html |
| Disallow | /*news-international-index*.html |
| Disallow | /*news-technology-index*.html |
| Disallow | /*news-health-index*.html |
| Disallow | /*news-india-index*.html |
| Disallow | /scripts/ |
| Disallow | /*?content_id=* |
| Disallow | /fb_oneindia_news/ |
| Disallow | /viral-share/ |
| Disallow | /press-release/* |
| Disallow | /search/results.html* |
| Disallow | /*?page* |
| Disallow | /*?story* |
| Disallow | /amphtml/topic/* |
| Disallow | /amphtml/*/articlecontent-pf* |
| Disallow | /common/mykhel_block/* |
| Disallow | /videos/amphtml/ |
| Disallow | /videos/amphtml/* |
| Disallow | /videos/search-videos/ |
| Disallow | /videos/homepagewidget/* |
| Disallow | /videos/tagfeeds/* |
| Disallow | /videos/locationfeeds_es/* |
| Disallow | /db-common/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.oneindia.com/sitemap_news.xml |
| sitemap | https://www.oneindia.com/sitemap-2024-index.xml |
| sitemap | https://www.oneindia.com/sitemap-2023-index.xml |
| sitemap | https://www.oneindia.com/sitemap-2022-index.xml |
| sitemap | https://www.oneindia.com/sitemap-categories.xml |
| sitemap | https://www.oneindia.com/sitemap-webstories-index.xml |
| sitemap | https://www.oneindia.com/sitemap-videos-index.xml |
| sitemap | https://www.oneindia.com/sitemap-images-index.xml |
| sitemap | https://www.oneindia.com/sitemap_cities.xml |