myblog.de
robots.txt

Robots Exclusion Standard data for myblog.de

Resource Scan

Scan Details

Site Domain myblog.de
Base Domain myblog.de
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-07-31T15:16:25+00:00
Next Scan 2024-10-29T15:16:25+00:00

Last Successful Scan

Scanned2023-01-05T20:52:44+00:00
URL https://myblog.de/robots.txt
Redirect https://www.myblog.de/robots.txt
Redirect Domain www.myblog.de
Redirect Base myblog.de
Domain IPs 164.68.105.106
Redirect IPs 164.68.105.106
Response IP 164.68.105.106
Found Yes
Hash f7b033d36f88005205ee64d02dd51a1b622bad2dacb3a12769930f2639ade6c6
SimHash 0c4d3060ded3

Groups

*

Rule Path
Disallow /img/counter?magic=
Disallow /ap/profile.php?uid=nejat.eryigit

infohelfer

Rule Path
Disallow /

kraken

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

pixraybot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.myblog.de/sitemap.xml