themelock.com
robots.txt

Robots Exclusion Standard data for themelock.com

Resource Scan

Scan Details

Site Domain themelock.com
Base Domain themelock.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-21T10:08:51+00:00
Next Scan 2025-08-19T10:08:51+00:00

Last Successful Scan

Scanned2023-01-31T07:47:41+00:00
URL https://themelock.com/robots.txt
Domain IPs 104.21.87.97, 172.67.169.49, 2606:4700:3030::ac43:a931, 2606:4700:3033::6815:5761
Response IP 104.21.87.97
Found Yes
Hash d46ee62a5570c96637ecd59d5ab2057c408de0fc8fa869c3d23b6502765dc050
SimHash d90db5704033

Groups

*

Rule Path
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch

semrushbot

Rule Path
Disallow /