mw.lt
robots.txt

Robots Exclusion Standard data for mw.lt

Resource Scan

Scan Details

Site Domain mw.lt
Base Domain mw.lt
Scan Status Ok
Last Scan5/8/2025, 8:32:10 PM
Next Scan 6/7/2025, 8:32:10 PM

Last Scan

Scanned5/8/2025, 8:32:10 PM
URL https://mw.lt/robots.txt
Redirect http://xtgem.com/robots.txt
Redirect Domain xtgem.com
Redirect Base xtgem.com
Domain IPs 141.94.172.213
Redirect IPs 104.21.62.197, 172.67.138.193, 2606:4700:3030::6815:3ec5, 2606:4700:3031::ac43:8ac1
Response IP 104.21.62.197
Found Yes
Hash 25f693d39f04e4dbad06b5b89ff05156ec46f752873e1c2f62be3fd25f2c1ea5
SimHash a80c5ca0c913

Groups

*

Rule Path
Disallow /autologin/

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap /sitemap.xml.gz