jw.lt
robots.txt

Robots Exclusion Standard data for jw.lt

Resource Scan

Scan Details

Site Domain jw.lt
Base Domain jw.lt
Scan Status Ok
Last Scan2025-04-09T12:57:39+00:00
Next Scan 2025-05-09T12:57:39+00:00

Last Scan

Scanned2025-04-09T12:57:39+00:00
URL https://jw.lt/robots.txt
Redirect http://xtgem.com/robots.txt
Redirect Domain xtgem.com
Redirect Base xtgem.com
Domain IPs 141.94.172.213
Redirect IPs 104.21.62.197, 172.67.138.193, 2606:4700:3030::6815:3ec5, 2606:4700:3031::ac43:8ac1
Response IP 172.67.138.193
Found Yes
Hash 25f693d39f04e4dbad06b5b89ff05156ec46f752873e1c2f62be3fd25f2c1ea5
SimHash a80c5ca0c913

Groups

*

Rule Path
Disallow /autologin/

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap /sitemap.xml.gz