Log In Sign Up

manthri.lk
robots.txt

Robots Exclusion Standard data for manthri.lk

Resource Scan

Scan Details

Site Domain manthri.lk
Base Domain manthri.lk
Scan Status Ok
Last Scan2025-09-19T20:34:43+00:00
Next Scan 2025-10-19T20:34:43+00:00

Last Scan

Scanned2025-09-19T20:34:43+00:00
URL https://manthri.lk/robots.txt
Domain IPs 104.21.7.190, 172.67.187.248, 2606:4700:3032::ac43:bbf8, 2606:4700:3035::6815:7be
Response IP 104.21.7.190
Found Yes
Hash 4f82ab6a531086775f11b98955d26c330492563833dd43153dfb7847b54c5e0f
SimHash b2852d8d6454

Groups

*

Rule Path
Disallow /cms/
Disallow /admin/
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top