lobster.de
robots.txt

Robots Exclusion Standard data for lobster.de

Resource Scan

Scan Details

Site Domain lobster.de
Base Domain lobster.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-03-25T03:11:17+00:00
Next Scan 2025-04-24T03:11:17+00:00

Last Successful Scan

Scanned2025-02-01T03:10:31+00:00
URL https://lobster.de/robots.txt
Redirect https://www.lobster-world.com/robots.txt
Redirect Domain www.lobster-world.com
Redirect Base lobster-world.com
Domain IPs 79.124.76.54
Redirect IPs 104.21.3.35, 172.67.130.42, 2606:4700:3035::6815:323, 2606:4700:3036::ac43:822a
Response IP 104.21.3.35
Found Yes
Hash 54f7217f66f25d4aade64cc3b2949c45ba65f1c1871e4106bd3c59d5e9a73e2a
SimHash 3510c5046312

Groups

*

Rule Path
Disallow /online/