Log In Sign Up

ft.lk
robots.txt

Robots Exclusion Standard data for ft.lk

Resource Scan

Scan Details

Site Domain ft.lk
Base Domain ft.lk
Scan Status Ok
Last Scan2024-11-09T16:38:49+00:00
Next Scan 2024-11-16T16:38:49+00:00

Last Scan

Scanned2024-11-09T16:38:49+00:00
URL https://ft.lk/robots.txt
Redirect https://www.ft.lk/robots.txt
Redirect Domain www.ft.lk
Redirect Base ft.lk
Domain IPs 104.26.10.230, 104.26.11.230, 172.67.69.233, 2606:4700:20::681a:ae6, 2606:4700:20::681a:be6, 2606:4700:20::ac43:45e9
Redirect IPs 104.26.10.230, 104.26.11.230, 172.67.69.233, 2606:4700:20::681a:ae6, 2606:4700:20::681a:be6, 2606:4700:20::ac43:45e9
Response IP 104.26.10.230
Found Yes
Hash 2bd6b05215b550d5f45d02df4d4d14d667d52d3b1d60ad3ef6cbaf0010942652
SimHash 6a48d151d135

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /

slurp

Rule Path
Allow /

msnbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.ft.lk/sitemaps
Back to top