hindi.oneindia.com
robots.txt
Robots Exclusion Standard data for hindi.oneindia.com
Resource Scan
Scan Details
| Site Domain | hindi.oneindia.com |
| Base Domain | oneindia.com |
| Scan Status | Ok |
| Last Scan | 2024-05-16T23:46:58+00:00 |
| Next Scan | 2024-06-15T23:46:58+00:00 |
Last Scan
| Scanned | 2024-05-16T23:46:58+00:00 |
| URL | https://hindi.oneindia.com/robots.txt |
| Domain IPs | 104.18.8.249, 104.18.9.249, 2606:4700::6812:8f9, 2606:4700::6812:9f9 |
| Response IP | 104.18.9.249 |
| Found | Yes |
| Hash | 117e9ab4a081937bc21646ed4604dadcf753bb148d4eaa62420bcea018f1828f |
| SimHash | 0f20dfc517c1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /peep/ |
| Disallow | /money/*/includes/ |
| Disallow | /temp/ |
| Disallow | /amphtml/temp/ |
| Disallow | /undefined/ |
| Disallow | /404.html |
| Disallow | /videos/searchby/ |
| Disallow | /*?content_id=* |
| Disallow | /*?PageSpeed=* |
| Disallow | /*/%25e0* |
| Disallow | /in-focus/ |
| Disallow | /bookmarks/ |
| Disallow | /blogs/ |
| Disallow | /infographics/ |
| Disallow | /plus18/ |
| Disallow | */plus18/* |
| Disallow | /scripts/ |
| Disallow | /*vjsembed* |
| Disallow | */?page-no=* |
| Disallow | /*?ref* |
| Disallow | /search/results.html* |
| Disallow | /*?page* |
| Disallow | /*?story* |
| Disallow | /amphtml/topic/* |
| Disallow | /amphtml/*/articlecontent-pf* |
| Disallow | /common/mykhel_block/* |
| Disallow | /videos/amphtml/ |
| Disallow | /videos/amphtml/* |
| Disallow | /videos/search-videos/ |
| Disallow | /videos/homepagewidget/* |
| Disallow | /videos/tagfeeds/* |
| Disallow | /videos/locationfeeds_es/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://hindi.oneindia.com/sitemap_news.xml |
| sitemap | https://hindi.oneindia.com/sitemap-2023-index.xml |
| sitemap | https://hindi.oneindia.com/sitemap-2022-index.xml |
| sitemap | https://hindi.oneindia.com/sitemap-categories.xml |
| sitemap | https://hindi.oneindia.com/sitemap-webstories-index.xml |
| sitemap | https://hindi.oneindia.com/sitemap_cities.xml |
| sitemap | https://hindi.oneindia.com/sitemap-videos-index.xml |
| sitemap | https://hindi.oneindia.com/sitemap-dictionary.xml |
| sitemap | https://hindi.oneindia.com/sitemap-images-index.xml |