butlr.io
robots.txt
Robots Exclusion Standard data for butlr.io
Resource Scan
Scan Details
| Site Domain | butlr.io |
| Base Domain | butlr.io |
| Scan Status | Ok |
| Last Scan | 2025-09-07T03:22:04+00:00 |
| Next Scan | 2025-10-07T03:22:04+00:00 |
Last Scan
| Scanned | 2025-09-07T03:22:04+00:00 |
| URL | https://butlr.io/robots.txt |
| Redirect | https://www.butlr.com/robots.txt |
| Redirect Domain | www.butlr.com |
| Redirect Base | butlr.com |
| Domain IPs | 75.2.70.75, 99.83.190.102 |
| Redirect IPs | 52.68.134.190, 54.238.67.66, 57.180.160.60 |
| Response IP | 13.203.125.58 |
| Found | Yes |
| Hash | 348b9b5e5a7ca2f5b34f0edadce870c560ec539ecdd51c83197e57c7d38431e1 |
| SimHash | 68016b60cf81 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /admin/ |
| Disallow | /login/ |
| Disallow | /register/ |
| Disallow | /config/ |
| Disallow | /dev/ |
| Disallow | /staging/ |
| Disallow | /beta/ |
| Disallow | /cgi-bin/ |
| Disallow | /scripts/ |
| Disallow | /blog?category=workspaces |
| Disallow | /blog?category=operations |
| Disallow | /blog?category=partnerships |
| Disallow | /blog?category=research |
| Disallow | /blog?category=design%20and%20data |
| Disallow | /blog?category=insights |
| Disallow | /blog?category=senior%20wellness |
| Disallow | /blog?category=sustainability |
| Disallow | /deal/ |
| Disallow | /deal/product-Matamanoa-Island-Resort-at-Expedia-Inc.html |
| Disallow | /deal/product-Brennaa-Black-at-Heels.html |
| Disallow | /deal/Pet-Octopus.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.butlr.com/sitemap.xml |