mw.lt
robots.txt
Robots Exclusion Standard data for mw.lt
Resource Scan
Scan Details
Site Domain | mw.lt |
Base Domain | mw.lt |
Scan Status | Ok |
Last Scan | 5/8/2025, 8:32:10 PM |
Next Scan | 6/7/2025, 8:32:10 PM |
Last Scan
Scanned | 5/8/2025, 8:32:10 PM |
URL | https://mw.lt/robots.txt |
Redirect | http://xtgem.com/robots.txt |
Redirect Domain | xtgem.com |
Redirect Base | xtgem.com |
Domain IPs | 141.94.172.213 |
Redirect IPs | 104.21.62.197, 172.67.138.193, 2606:4700:3030::6815:3ec5, 2606:4700:3031::ac43:8ac1 |
Response IP | 104.21.62.197 |
Found | Yes |
Hash | 25f693d39f04e4dbad06b5b89ff05156ec46f752873e1c2f62be3fd25f2c1ea5 |
SimHash | a80c5ca0c913 |
Groups
Other Records
Field | Value |
---|---|
sitemap | /sitemap.xml.gz |