robertkraus.eu
robots.txt

Robots Exclusion Standard data for robertkraus.eu

Resource Scan

Scan Details

Site Domain robertkraus.eu
Base Domain robertkraus.eu
Scan Status Ok
Last Scan2025-09-03T06:58:09+00:00
Next Scan 2025-10-03T06:58:09+00:00

Last Scan

Scanned2025-09-03T06:58:09+00:00
URL https://robertkraus.eu/robots.txt
Domain IPs 3.65.102.101, 3.71.253.221
Response IP 3.65.102.101
Found Yes
Hash 9cc73ec03d383849b03f0abd9b72e2ce7769c6421de867b565123e86b15da465
SimHash 6d54dc1083d3

Groups

psbot

Rule Path
Disallow /

*

Rule Path
Disallow /servers/frontend/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://robertkraus.eu/sitemap.xml