uni-goettingen.de
robots.txt

Robots Exclusion Standard data for uni-goettingen.de

Resource Scan

Scan Details

Site Domain uni-goettingen.de
Base Domain uni-goettingen.de
Scan Status Ok
Last Scan2024-10-03T08:46:19+00:00
Next Scan 2024-11-02T08:46:19+00:00

Last Scan

Scanned2024-10-03T08:46:19+00:00
URL https://uni-goettingen.de/robots.txt
Domain IPs 134.76.18.234
Response IP 134.76.18.234
Found Yes
Hash 0ae4d9b3c78e2366ef0598512b371ae21823aeb507f41a023ea53bc7a8097d19
SimHash 800e78c0c3d3

Groups

*

Rule Path
Disallow /css/
Disallow /js/
Disallow /admin/bilder/
Disallow /docs/
Disallow /downloads/
Disallow /storage/docs/
Disallow /storage/downloads/
Disallow /storage/pictures/
Disallow /storage/upload/
Disallow /storage/userdata/
Disallow /error.php
Disallow /index.php
Disallow /verify.php

webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea
dataforseobot

Rule Path
Disallow /

Comments

  • robots.txt zu http://www.uni-goettingen.de