wbmoodle.uni-leipzig.de
robots.txt

Robots Exclusion Standard data for wbmoodle.uni-leipzig.de

Resource Scan

Scan Details

Site Domain wbmoodle.uni-leipzig.de
Base Domain uni-leipzig.de
Scan Status Ok
Last Scan2025-10-29T06:06:37+00:00
Next Scan 2025-11-12T06:06:37+00:00

Last Scan

Scanned2025-10-29T06:06:37+00:00
URL https://wbmoodle.uni-leipzig.de/robots.txt
Domain IPs 139.18.16.153
Response IP 139.18.16.153
Found Yes
Hash 0bbe7287e5a5c8851d2c7417d89de9fe8dc0b278a76c061312282cdea010387b
SimHash 649859726090

Groups

*

Rule Path
Disallow /mod/forum/search.php
Disallow /course/recent.php
Disallow /sites/
Disallow /sites/*.*
Disallow /local/moodleorg/top/sites/
Disallow /local/moodleorg/top/sites/*.*
Disallow /plugins/download.php
Disallow /plugins/download.php/*/*.*

Other Records

Field Value
crawl-delay 20

adsbot-google

Rule Path
Disallow /*.*

Comments

  • BEGIN ANSIBLE MANAGED BLOCK
  • END ANSIBLE MANAGED BLOCK

Warnings

  • `request-rate` is not a known field.