serve.mdpi.com
robots.txt

Robots Exclusion Standard data for serve.mdpi.com

Resource Scan

Scan Details

Site Domain serve.mdpi.com
Base Domain mdpi.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan5/8/2025, 8:55:00 PM
Next Scan 6/7/2025, 8:55:00 PM

Last Successful Scan

Scanned3/17/2025, 8:53:51 PM
URL https://serve.mdpi.com/robots.txt
Domain IPs 104.18.24.151, 104.18.25.151
Response IP 104.18.25.151
Found Yes
Hash 646f489cb651ec4cdbb7d9601d4cbd0ef949aef7a076d2b544dada3c7ccd9235
SimHash b837430503d2

Groups

*

Rule Path
Disallow /

Comments

  • This robots.txt file requests that search engines and other
  • automated web-agents don't try to index the files in this
  • directory. This file is required in the event that you use
  • Revive Adserver without virtual domains (i.e. you use a
  • single URL to run both the admin interface and the delivery
  • engine), and have the web root set to this directory.