Log In Sign Up

itpro.lk
robots.txt

Robots Exclusion Standard data for itpro.lk

Resource Scan

Scan Details

Site Domain itpro.lk
Base Domain itpro.lk
Scan Status Ok
Last Scan2026-02-05T13:10:03+00:00
Next Scan 2026-03-07T13:10:03+00:00

Last Scan

Scanned2026-02-05T13:10:03+00:00
URL https://itpro.lk/robots.txt
Domain IPs 185.162.89.104
Response IP 185.162.89.104
Found Yes
Hash 7d960d46c0c483cba7146a4a979d4c8677df3dcc859347358362c843836fd36e
SimHash c80c8a53cff2

Groups

*

Rule Path
Disallow /_lib/
Disallow /_tpl/
Disallow /admin/
Disallow /config/
Disallow /uploads/private/

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /
Disallow /*?

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://itpro.lk/sitemap.xml
Back to top

Comments

  • robots.txt for ITPro.lk
  • Allow specific access to other uploads if needed
Back to top