Log In Sign Up

lw.lk
robots.txt

Robots Exclusion Standard data for lw.lk

Resource Scan

Scan Details

Site Domain lw.lk
Base Domain lw.lk
Scan Status Ok
Last Scan2024-09-20T12:41:11+00:00
Next Scan 2024-09-27T12:41:11+00:00

Last Scan

Scanned2024-09-20T12:41:11+00:00
URL https://lw.lk/robots.txt
Redirect https://www.lw.lk/robots.txt
Redirect Domain www.lw.lk
Redirect Base lw.lk
Domain IPs 104.21.81.47, 172.67.188.45, 2606:4700:3030::ac43:bc2d, 2606:4700:3034::6815:512f
Redirect IPs 104.21.81.47, 172.67.188.45, 2606:4700:3030::ac43:bc2d, 2606:4700:3034::6815:512f
Response IP 172.67.188.45
Found Yes
Hash 228506597932c8c829a1a5b28f4cd06acdb60bba8eb20a3310ebec24fb65de83
SimHash 6848d151c131

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /

slurp

Rule Path
Allow /

msnbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap http://www.dailymirror.lk/sitemaps
Back to top