librebor.me
robots.txt
Robots Exclusion Standard data for librebor.me
Resource Scan
Scan Details
| Site Domain | librebor.me |
| Base Domain | librebor.me |
| Scan Status | Ok |
| Last Scan | 2025-07-13T09:12:23+00:00 |
| Next Scan | 2025-08-12T09:12:23+00:00 |
Last Scan
| Scanned | 2025-07-13T09:12:23+00:00 |
| URL | https://librebor.me/robots.txt |
| Domain IPs | 104.26.12.121, 104.26.13.121, 172.67.72.152, 2606:4700:20::681a:c79, 2606:4700:20::681a:d79, 2606:4700:20::ac43:4898 |
| Response IP | 104.26.13.121 |
| Found | Yes |
| Hash | baa4e7e762bbf0aebcb69a21894691d542a2c3520c826120daa4ec18b2401879 |
| SimHash | 515ed8568683 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /static/ |
| Disallow | /borme/ajax/ |
| Disallow | /borme/api/ |
| Disallow | /borme/borme/ |
| Disallow | /borme/busqueda/ |
| Disallow | /borme/cve/ |
| Disallow | /borme/*.csv$ |
| Disallow | /cookies/ |
| Disallow | /dashboard/ |
| Disallow | /en/ |
| Disallow | /me-interesa/* |
| Disallow | /politica-de-privacidad/ |
| Disallow | /terminos-y-condiciones/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://librebor.me/sitemap.xml |