Open-source tools, tested in a lab
Open-source, self-hostable tools, tested in an isolated lab VM and scored in six gates. We follow the install docs exactly, measure what the tool really uses, crash it, check its project and its security, and publish every number with its source.
Latest verdict
OSV-001 / Push notifications / tested 2026-10-12 to 14
ntfy 2.30.0
Use with care 7.3 / 10
Read the full test
All results
| Tool | Category | Verdict | Overall | Tested | Episode |
|---|---|---|---|---|---|
| ntfy 2.30.0 | Push notifications | Use with care | 7.3 | 2026-10-12 to 14 | OSV-001 |
How we test
- Install: the official container install, exactly as documented, behind a reverse proxy
- Resources: idle use, a steady load, and the point where it cannot keep up
- Real use: three use cases from the category's test card, one with a second user
- Resilience: kill mid-write, a crash with no sync, an upgrade, backup and restore, data exit
- Health: five project metrics over the last 12 months
- Security: secure by default, least privilege, egress, account protection, vulnerability handling
Each gate scores 0 to 10 by fixed rules; the overall is their mean, and caps keep a serious failure from hiding behind a good average. The whole method.