Log In Sign Up

webstats1.com
robots.txt

Robots Exclusion Standard data for webstats1.com

Resource Scan

Scan Details

Site Domain webstats1.com
Base Domain webstats1.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-26T13:08:06+00:00
Next Scan 2026-03-26T13:08:06+00:00

Last Successful Scan

Scanned2023-05-09T10:30:08+00:00
URL https://webstats1.com/robots.txt
Domain IPs 104.21.34.49, 172.67.198.32, 2606:4700:3032::ac43:c620, 2606:4700:3035::6815:2231
Response IP 172.67.198.32
Found Yes
Hash 646f489cb651ec4cdbb7d9601d4cbd0ef949aef7a076d2b544dada3c7ccd9235
SimHash b837430503d2

Groups

*

Rule Path
Disallow /
Back to top

Comments

  • This robots.txt file requests that search engines and other
  • automated web-agents don't try to index the files in this
  • directory. This file is required in the event that you use
  • Revive Adserver without virtual domains (i.e. you use a
  • single URL to run both the admin interface and the delivery
  • engine), and have the web root set to this directory.
Back to top