Log In Sign Up

digitize.lk
robots.txt

Robots Exclusion Standard data for digitize.lk

Resource Scan

Scan Details

Site Domain digitize.lk
Base Domain digitize.lk
Scan Status Ok
Last Scan2026-01-08T17:24:51+00:00
Next Scan 2026-02-07T17:24:51+00:00

Last Scan

Scanned2026-01-08T17:24:51+00:00
URL https://digitize.lk/robots.txt
Domain IPs 104.21.87.57, 172.67.141.232, 2606:4700:3030::ac43:8de8, 2606:4700:3034::6815:5739
Response IP 172.67.141.232
Found Yes
Hash 08d32d3e94e391c24a72494cddc7ffb97d0cad1bb793a7174e919987f1ccdc91
SimHash 63f980a78796

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3
Back to top

Other Records

Field Value
sitemap https://digitize.lk/sitemap.xml
sitemap https://digitize.lk/sitemapindex.xml
sitemap https://digitize.lk/sitemapmobileindex.xml
sitemap https://digitize.lk/sitemap-hot-2308004.xml
sitemap https://digitize.lk/sitemap-hot-2306004.xml
sitemap https://digitize.lk/sitemap-hot-2304004.xml
sitemap https://digitize.lk/sitemap-hot-2302004.xml
sitemap https://digitize.lk/sitemap-hot-2300004.xml
sitemap https://digitize.lk/sitemap-hot-2298004.xml
sitemap https://digitize.lk/sitemap-hot-2296004.xml
sitemap https://digitize.lk/sitemap-hot-2294004.xml
sitemap https://digitize.lk/sitemap-hot-2292004.xml
sitemap https://digitize.lk/sitemap-hot-2290004.xml
sitemap https://digitize.lk/sitemap-hot-2288004.xml
sitemap https://digitize.lk/sitemap-hot-2286004.xml
sitemap https://digitize.lk/sitemap-hot-2284004.xml
sitemap https://digitize.lk/sitemap-hot-2282004.xml
sitemap https://digitize.lk/sitemap-hot-2280004.xml
sitemap https://digitize.lk/sitemap-hot-2278004.xml
Back to top