unimog-community.de
robots.txt

Robots Exclusion Standard data for unimog-community.de

Resource Scan

Scan Details

Site Domain unimog-community.de
Base Domain unimog-community.de
Scan Status Ok
Last Scan2024-09-28T20:42:44+00:00
Next Scan 2024-10-05T20:42:44+00:00

Last Scan

Scanned2024-09-28T20:42:44+00:00
URL https://unimog-community.de/robots.txt
Redirect https://www.unimog-community.de/robots.txt
Redirect Domain www.unimog-community.de
Redirect Base unimog-community.de
Domain IPs 88.198.125.145
Redirect IPs 88.198.125.145
Response IP 88.198.125.145
Found Yes
Hash ee61075fc226ef88f2a80e8d6507255d3e965d60fb6c6546ea72477c3f8bc431
SimHash 88789ca2ea60

Groups

*

Rule Path
Disallow /adm/
Disallow /styles/

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

augustbot

Rule Path
Disallow /

java

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

lycosa

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /