betterstack.dev
robots.txt
Robots Exclusion Standard data for betterstack.dev
Resource Scan
Scan Details
| Site Domain | betterstack.dev |
| Base Domain | betterstack.dev |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-08-23T08:33:39+00:00 |
| Next Scan | 2025-09-06T08:33:39+00:00 |
Last Successful Scan
| Scanned | 2025-05-09T06:41:40+00:00 |
| URL | https://betterstack.dev/robots.txt |
| Domain IPs | 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001 |
| Response IP | 104.21.96.1 |
| Found | Yes |
| Hash | d925ab50de87c2fcf1ce5b69aeec8340e6737b576d45b8c9013513d77e49b0d5 |
| SimHash | e91c6e01ef10 |
Groups
*
| Rule | Path |
|---|---|
| Disallow |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /assets/betterstack/bs-hero-illustration-1ced91e19395e877cbf9d5917d2663ce19da6cc97eb9e1195f0619d6cd4070a7.jpg |
| Disallow | /assets/betterstack/bs-hero-illustration-sm-2c8555bb9be136a2aac87b7f38db39237aeca68bc16556e4ae3f9f0cd24a72d1.jpg |
| Disallow | /assets/betterstack/bs-hero-icon-23f8baf42d7aab6d6066c716681fc07ecc289b7969f2d52e80aab31b05b076ee.png |
| Disallow | /assets/betterstack/hiring-bg-7cd2e4d2d22db9b9103b5a2e4486ac1d51a167b93b43069f8ead1ffca99088db.jpg |
| Disallow | /assets/betterstack/hiring-bg-sm-fc2f177a39f20d87a0efbf697bada13da732c8e1e077720a86128eed32c39190.jpg |
Other Records
| Field | Value |
|---|---|
| sitemap | https://betterstack.dev/sitemap.xml |
| sitemap | https://betterstack.dev/articles-sitemap.xml |
| sitemap | https://betterstack.dev/docs-sitemap.xml |