Log In Sign Up

content.oneindia.com
robots.txt

Robots Exclusion Standard data for content.oneindia.com

Resource Scan

Scan Details

Site Domain content.oneindia.com
Base Domain oneindia.com
Scan Status Ok
Last Scan2024-05-14T06:18:31+00:00
Next Scan 2024-06-13T06:18:31+00:00

Last Scan

Scanned2024-05-14T06:18:31+00:00
URL https://content.oneindia.com/robots.txt
Domain IPs 104.18.8.249, 104.18.9.249, 2606:4700::6812:8f9, 2606:4700::6812:9f9
Response IP 104.18.8.249
Found Yes
Hash 646f489cb651ec4cdbb7d9601d4cbd0ef949aef7a076d2b544dada3c7ccd9235
SimHash b837430503d2

Groups

*

Rule Path
Disallow /
Back to top

Comments

  • This robots.txt file requests that search engines and other
  • automated web-agents don't try to index the files in this
  • directory. This file is required in the event that you use
  • Revive Adserver without virtual domains (i.e. you use a
  • single URL to run both the admin interface and the delivery
  • engine), and have the web root set to this directory.
Back to top