Log In Sign Up

lankawebsites.com
robots.txt

Robots Exclusion Standard data for lankawebsites.com

Resource Scan

Scan Details

Site Domain lankawebsites.com
Base Domain lankawebsites.com
Scan Status Ok
Last Scan2026-02-06T10:30:43+00:00
Next Scan 2026-02-13T10:30:43+00:00

Last Scan

Scanned2026-02-06T10:30:43+00:00
URL https://lankawebsites.com/robots.txt
Domain IPs 172.104.62.81
Response IP 172.104.62.81
Found Yes
Hash 129e62f72f78e9132cf46ce6abb40eedc5dd37b1ffedba51ca93df05927586be
SimHash 0d085ed1a621

Groups

*

Rule Path
Allow /
Disallow /admin
Disallow /horizon
Disallow /telescope
Disallow /api/

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://lankawebsites.com/sitemap.xml
Back to top

Comments

  • Robots.txt for lankawebsites.com
  • Sitemaps
  • Disallow admin areas
  • Disallow API endpoints
  • Crawl delay (optional, helps reduce server load)
Back to top