Log In Sign Up

webstatsg.com
robots.txt

Robots Exclusion Standard data for webstatsg.com

Resource Scan

Scan Details

Site Domain webstatsg.com
Base Domain webstatsg.com
Scan Status Ok
Last Scan2025-05-06T02:47:28+00:00
Next Scan 2025-06-05T02:47:28+00:00

Last Scan

Scanned2025-05-06T02:47:28+00:00
URL https://webstatsg.com/robots.txt
Domain IPs 104.21.38.59, 172.67.219.140, 2606:4700:3031::ac43:db8c, 2606:4700:3035::6815:263b
Response IP 172.67.219.140
Found Yes
Hash 646f489cb651ec4cdbb7d9601d4cbd0ef949aef7a076d2b544dada3c7ccd9235
SimHash b837430503d2

Groups

*

Rule Path
Disallow /
Back to top

Comments

  • This robots.txt file requests that search engines and other
  • automated web-agents don't try to index the files in this
  • directory. This file is required in the event that you use
  • Revive Adserver without virtual domains (i.e. you use a
  • single URL to run both the admin interface and the delivery
  • engine), and have the web root set to this directory.
Back to top