go-with-us.de
robots.txt

Robots Exclusion Standard data for go-with-us.de

Resource Scan

Scan Details

Site Domain go-with-us.de
Base Domain go-with-us.de
Scan Status Ok
Last Scan2024-08-30T23:45:39+00:00
Next Scan 2024-09-29T23:45:39+00:00

Last Scan

Scanned2024-08-30T23:45:39+00:00
URL https://go-with-us.de/robots.txt
Domain IPs 2a00:1169:103:7b60::, 92.205.210.102
Response IP 92.205.210.102
Found Yes
Hash dfc472594f92900e7d1c957dcbef5862341c2aad94a2b3c3c7baaa36297e7bd9
SimHash da356f30e882

Groups

*

Rule Path
Disallow /wp-register.php
Disallow /wp-login.php
Disallow /wp-admin/

bingbot
bingbot
megaindex
libwww-per
sentibot
miniflux
trendictionbot
semantic
rogerbot
exabot
dotbot
gigabot
chinaclaw
blexbot
mj12bot
twengabot
ahrefsbot
semrushbot
wotbox
sosospider
zumbot
netspider
pagegrabber
baiduspider

Rule Path
Disallow /

Warnings

  • 1 invalid line.