Log In Sign Up

lsd.law
robots.txt

Robots Exclusion Standard data for lsd.law

Resource Scan

Scan Details

Site Domain lsd.law
Base Domain lsd.law
Scan Status Ok
Last Scan2026-01-16T17:35:10+00:00
Next Scan 2026-01-23T17:35:10+00:00

Last Scan

Scanned2026-01-16T17:35:10+00:00
URL https://lsd.law/robots.txt
Domain IPs 104.21.49.176, 172.67.191.130, 2606:4700:3031::6815:31b0, 2606:4700:3032::ac43:bf82
Response IP 104.21.49.176
Found Yes
Hash d00bc55e2a0a0358a27b2b2ca34e1a75da75943fdad795fdc7f6fb948d1d4a8e
SimHash 6e068b12e2a3

Groups

*

Rule Path
Allow /
Disallow /users/
Disallow /admin/
Disallow /api/
Disallow /auth/
Disallow /subscription/
Disallow /courses/
Disallow /checkout/
Disallow /payment/
Disallow /chat
Disallow /molly/
Disallow /creep/
Disallow /creep-rando
Disallow /*?sort=
Disallow /*?page=
Disallow /*?filter=
Disallow /search?

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://lsd.law/sitemap.xml
Back to top

Comments

  • Robots.txt for LSD.Law
  • Last updated: 2024
  • Allow all web crawlers
  • Disallow access to user-specific pages
  • Disallow temporary or duplicate content
  • Sitemap location
  • Crawl delay (be nice to our servers)
Back to top