oneindia.com
robots.txt
Robots Exclusion Standard data for oneindia.com
Resource Scan
Scan Details
Site Domain | oneindia.com |
Base Domain | oneindia.com |
Scan Status | Ok |
Last Scan | 2024-04-26T14:10:28+00:00 |
Next Scan | 2024-05-03T14:10:28+00:00 |
Last Scan
Scanned | 2024-04-26T14:10:28+00:00 |
URL | https://oneindia.com/robots.txt |
Redirect | https://www.oneindia.com/robots.txt |
Redirect Domain | www.oneindia.com |
Redirect Base | oneindia.com |
Domain IPs | 104.18.8.249, 104.18.9.249, 2606:4700::6812:8f9, 2606:4700::6812:9f9 |
Redirect IPs | 104.18.8.249, 104.18.9.249, 2606:4700::6812:8f9, 2606:4700::6812:9f9 |
Response IP | 104.18.9.249 |
Found | Yes |
Hash | 0d06846a06decb041b9f2d58248dd58eb8b1c8e2aba780fcf54bb8a683425eac |
SimHash | ef26db401df4 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Allow | /*.js* |
Allow | /*.css* |
Disallow | /comment/ |
Disallow | /temp/ |
Disallow | /amphtml/temp/ |
Disallow | /test/ |
Disallow | /newsletter/ |
Disallow | /*news-business-index*.html |
Disallow | /*news-sports-index*.html |
Disallow | /*news-international-index*.html |
Disallow | /*news-technology-index*.html |
Disallow | /*news-health-index*.html |
Disallow | /*news-india-index*.html |
Disallow | /scripts/ |
Disallow | /*?content_id=* |
Disallow | /fb_oneindia_news/ |
Disallow | /viral-share/ |
Disallow | /press-release/* |
Disallow | /*?ref* |
Disallow | /search/results.html* |
Disallow | /*?page* |
Disallow | /*?story* |
Disallow | /amphtml/topic/* |
Disallow | /amphtml/*/articlecontent-pf* |
Disallow | /common/mykhel_block/* |
Disallow | /videos/amphtml/ |
Disallow | /videos/amphtml/* |
Disallow | /videos/search-videos/ |
Disallow | /videos/homepagewidget/* |
Disallow | /videos/tagfeeds/* |
Disallow | /videos/locationfeeds_es/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.oneindia.com/sitemap_news.xml |
sitemap | https://www.oneindia.com/sitemap-2023-index.xml |
sitemap | https://www.oneindia.com/sitemap-2022-index.xml |
sitemap | https://www.oneindia.com/sitemap-categories.xml |
sitemap | https://www.oneindia.com/sitemap-webstories-index.xml |
sitemap | https://www.oneindia.com/sitemap-videos-index.xml |
sitemap | https://www.oneindia.com/sitemap-images-index.xml |
sitemap | https://www.oneindia.com/sitemap_cities.xml |