sala.lk
robots.txt

Robots Exclusion Standard data for sala.lk

Resource Scan

Scan Details

Site Domain sala.lk
Base Domain sala.lk
Scan Status Ok
Last Scan2024-10-22T01:32:13+00:00
Next Scan 2024-11-21T01:32:13+00:00

Last Scan

Scanned2024-10-22T01:32:13+00:00
URL https://sala.lk/robots.txt
Redirect https://www.sala.lk/robots.txt
Redirect Domain www.sala.lk
Redirect Base sala.lk
Domain IPs 104.21.10.8, 172.67.189.217, 2606:4700:3032::6815:a08, 2606:4700:3033::ac43:bdd9
Redirect IPs 104.21.10.8, 172.67.189.217, 2606:4700:3032::6815:a08, 2606:4700:3033::ac43:bdd9
Response IP 104.21.10.8
Found Yes
Hash e826c519979b200c2c489ee61031c5d8cd28326320d0cf4127275ad2b3325799
SimHash 60157492c501

Groups

applebot

Rule Path
Allow /sitemap.xml/
Disallow /public/dbimages/
Disallow /app/controllers/
Disallow /app/models/
Disallow /app/views/admin/
Disallow /common/
Disallow /language/
Disallow /System/

baiduspider

Rule Path
Disallow /public/dbimages/
Disallow /app/controllers/
Disallow /app/models/
Disallow /app/views/admin/
Disallow /common/
Disallow /language/
Disallow /System/

bingbot

Rule Path
Allow /sitemap.xml/
Disallow /public/dbimages/
Disallow /app/controllers/
Disallow /app/models/
Disallow /app/views/admin/
Disallow /common/
Disallow /language/
Disallow /System/

googlebot

Rule Path
Allow /sitemap.xml/
Disallow /public/dbimages/
Disallow /app/controllers/
Disallow /app/models/
Disallow /app/views/admin/
Disallow /common/
Disallow /language/
Disallow /System/

ia_archiver

Rule Path
Allow /sitemap.xml/
Disallow /public/dbimages/
Disallow /app/controllers/
Disallow /app/models/
Disallow /app/views/admin/
Disallow /common/
Disallow /language/
Disallow /System/

msnbot

Rule Path
Allow /sitemap.xml/
Disallow /public/dbimages/
Disallow /app/controllers/
Disallow /app/models/
Disallow /app/views/admin/
Disallow /common/
Disallow /language/
Disallow /System/

naverbot

Rule Path
Allow /sitemap.xml/
Disallow /public/dbimages/
Disallow /app/controllers/
Disallow /app/models/
Disallow /app/views/admin/
Disallow /common/
Disallow /language/
Disallow /System/

seznambot

Rule Path
Allow /sitemap.xml/
Disallow /public/dbimages/
Disallow /app/controllers/
Disallow /app/models/
Disallow /app/views/admin/
Disallow /common/
Disallow /language/
Disallow /System/

slurp

Rule Path
Allow /sitemap.xml/
Disallow /public/dbimages/
Disallow /app/controllers/
Disallow /app/models/
Disallow /app/views/admin/
Disallow /common/
Disallow /language/
Disallow /System/

teoma

Rule Path
Allow /sitemap.xml/
Disallow /public/dbimages/
Disallow /app/controllers/
Disallow /app/models/
Disallow /app/views/admin/
Disallow /common/
Disallow /language/
Disallow /System/

twitterbot

Rule Path
Allow /sitemap.xml/
Disallow /dbimages/
Disallow /admin/
Disallow /common/

yandex

Rule Path
Allow /sitemap.xml/
Disallow /public/dbimages/
Disallow /app/controllers/
Disallow /app/models/
Disallow /app/views/admin/
Disallow /common/
Disallow /language/
Disallow /System/

yeti

Rule Path
Allow /sitemap.xml/
Disallow /public/dbimages/
Disallow /app/controllers/
Disallow /app/models/
Disallow /app/views/admin/
Disallow /common/
Disallow /language/
Disallow /System/

*

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.sala.lk/sitemap.xml
sitemap http://www.sala.lk/sitemap.xml
sitemap http://www.sala.lk/sitemap.xml
sitemap http://www.sala.lk/sitemap.xml
sitemap http://www.sala.lk/sitemap.xml
sitemap http://www.sala.lk/sitemap.xml
sitemap http://www.sala.lk/sitemap.xml
sitemap http://www.sala.lk/sitemap.xml
sitemap http://www.sala.lk/sitemap.xml
sitemap http://www.sala.lk/sitemap.xml
sitemap http://www.sala.lk/sitemap.xml
sitemap http://www.sala.lk/sitemap.xml
sitemap http://www.sala.lk/sitemap.xml