uni-bamberg.de
robots.txt

Robots Exclusion Standard data for uni-bamberg.de

Resource Scan

Scan Details

Site Domain uni-bamberg.de
Base Domain uni-bamberg.de
Scan Status Ok
Last Scan2024-11-16T11:23:56+00:00
Next Scan 2024-11-30T11:23:56+00:00

Last Scan

Scanned2024-11-16T11:23:56+00:00
URL https://uni-bamberg.de/robots.txt
Redirect https://www.uni-bamberg.de/robots.txt
Redirect Domain www.uni-bamberg.de
Redirect Base uni-bamberg.de
Domain IPs 141.13.240.24
Redirect IPs 141.13.240.24
Response IP 141.13.240.24
Found Yes
Hash f0dad2472ed33168e2daf667d6beb7e23627cdbe07cf0ef002c3714827bd587f
SimHash 2a5d8e81e892

Groups

sogou spider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

*

Rule Path
Disallow /typo3/
Disallow /*?type=3132

Other Records

Field Value
sitemap /sitemap.xml