soz.lk
robots.txt

Robots Exclusion Standard data for soz.lk

Resource Scan

Scan Details

Site Domain soz.lk
Base Domain soz.lk
Scan Status Ok
Last Scan2025-06-23T12:13:15+00:00
Next Scan 2025-06-30T12:13:15+00:00

Last Scan

Scanned2025-06-23T12:13:15+00:00
URL https://soz.lk/robots.txt
Redirect https://eksisozluk.com/robots.txt
Redirect Domain eksisozluk.com
Redirect Base eksisozluk.com
Domain IPs 104.21.93.149, 172.67.211.92, 2606:4700:3030::6815:5d95, 2606:4700:3037::ac43:d35c
Redirect IPs 104.22.68.190, 104.22.69.190, 172.67.37.226, 2606:4700:10::6816:44be, 2606:4700:10::6816:45be, 2606:4700:10::ac43:25e2
Response IP 104.22.69.190
Found Yes
Hash 17a3dd8655d568d98a6a498046fa25aad5290667d3c9d5d0459131816efd5e67
SimHash 400c0b458137

Groups

*

Rule Path
Allow /
Disallow /video/*

mediapartners-google

Rule Path
Disallow

microsoft url control

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://eksisozluk.com/sitemap.xml