mfbot.de
robots.txt

Robots Exclusion Standard data for mfbot.de

Resource Scan

Scan Details

Site Domain mfbot.de
Base Domain mfbot.de
Scan Status Ok
Last Scan2025-12-28T10:11:19+00:00
Next Scan 2026-01-04T10:11:19+00:00

Last Scan

Scanned2025-12-28T10:11:19+00:00
URL https://mfbot.de/robots.txt
Redirect https://www.mfbot.de/robots.txt
Redirect Domain www.mfbot.de
Redirect Base mfbot.de
Domain IPs 2a03:4000:30:8bbb::13:6221, 91.204.46.67
Redirect IPs 2a03:4000:30:8bbb::13:6221, 91.204.46.67
Response IP 91.204.46.67
Found Yes
Hash db45a0405b94c6ca4db0244223738f58064134eeab19921e7aa447f0866fc62a
SimHash a809d8008c92

Groups

semrushbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

*

Rule Path
Disallow /Download/

Other Records

Field Value
sitemap https://www.mfbot.de/sitemap_index.xml