Log In Sign Up

lexius.io
robots.txt

Robots Exclusion Standard data for lexius.io

Resource Scan

Scan Details

Site Domain lexius.io
Base Domain lexius.io
Scan Status Ok
Last Scan2025-10-19T02:31:31+00:00
Next Scan 2025-11-18T02:31:31+00:00

Last Scan

Scanned2025-10-19T02:31:31+00:00
URL https://lexius.io/robots.txt
Domain IPs 172.66.40.76, 172.66.43.180, 2606:4700:3108::ac42:284c, 2606:4700:3108::ac42:2bb4
Response IP 172.66.43.180
Found Yes
Hash 54a9e2b885fbc92398fa0a39a4931c5c7945d3ae515bd6b10ac7b41921b82808
SimHash 2135dbd3eda1

Groups

*

Rule Path
Allow /
Allow /*/
Allow /*/prueba/
Allow /*/planes/
Allow /*/contenido/
Allow /*/funciones/
Allow /*/descarga/
Allow /*/guia-de-uso/
Allow /*/nosotros/
Allow /politicas-de-privacidad/
Allow /terminos-y-condiciones/
Disallow /admin/
Disallow /api/internal/
Disallow /.git/
Disallow /static/logs/
Allow /static/
Allow /media/

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://lexius.io/sitemap.xml
Back to top

Comments

  • Sitemaps
  • Crawl delays for respectful crawling
  • Allow search engines to access all important pages
  • Block admin or sensitive areas (if any in the future)
  • Allow media and static files
Back to top