artikel-presse.de
robots.txt

Robots Exclusion Standard data for artikel-presse.de

Resource Scan

Scan Details

Site Domain artikel-presse.de
Base Domain artikel-presse.de
Scan Status Ok
Last Scan2024-06-12T12:08:42+00:00
Next Scan 2024-07-12T12:08:42+00:00

Last Scan

Scanned2024-06-12T12:08:42+00:00
URL https://artikel-presse.de/robots.txt
Domain IPs 85.13.148.209
Response IP 85.13.148.209
Found Yes
Hash dfc472594f92900e7d1c957dcbef5862341c2aad94a2b3c3c7baaa36297e7bd9
SimHash da356f30e882

Groups

*

Rule Path
Disallow /wp-register.php
Disallow /wp-login.php
Disallow /wp-admin/

bingbot
bingbot
megaindex
libwww-per
sentibot
miniflux
trendictionbot
semantic
rogerbot
exabot
dotbot
gigabot
chinaclaw
blexbot
mj12bot
twengabot
ahrefsbot
semrushbot
wotbox
sosospider
zumbot
netspider
pagegrabber
baiduspider

Rule Path
Disallow /

Warnings

  • 1 invalid line.