lustpunkt18.com
robots.txt

Robots Exclusion Standard data for lustpunkt18.com

Resource Scan

Scan Details

Site Domain lustpunkt18.com
Base Domain lustpunkt18.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-16T19:42:26+00:00
Next Scan 2026-04-16T19:42:26+00:00

Last Successful Scan

Scanned2023-09-05T22:11:02+00:00
URL https://lustpunkt18.com/robots.txt
Redirect https://www.lustpunkt18.com/robots.txt
Redirect Domain www.lustpunkt18.com
Redirect Base lustpunkt18.com
Domain IPs 104.26.4.67, 104.26.5.67, 172.67.69.200, 2606:4700:20::681a:443, 2606:4700:20::681a:543, 2606:4700:20::ac43:45c8
Redirect IPs 104.26.4.67, 104.26.5.67, 172.67.69.200, 2606:4700:20::681a:443, 2606:4700:20::681a:543, 2606:4700:20::ac43:45c8
Response IP 172.67.69.200
Found Yes
Hash 31e863262f75d2836312e624eb2cb9e8945b7ecc3f3cb9f99c357a6905eff7f0
SimHash 0114243347c0

Groups

*
bingbot

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

cutestat

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

facebot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

wget

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

httrack

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /