Staff Software Engineer at Meroxa working on conduit.io
Benchi is a minimal benchmarking framework designed to help you measure the performance of your applications and infrastructure. It leverages Docker to create isolated environments for running benchmarks and collecting metrics.
By Lovro Mažgon
26 Mar 2025
In this blog, we dive into how Conduit transitioned from a flexible but slower architecture to a high-performance streaming engine. We explore the limitations of the old DAG-based design, its impact on ordering guarantees and backpressure, and why switching to a Worker-Task Model drastically improved throughput and efficiency. With real-world performance benchmarks showing a 5x increase in message throughput, this blog is a must-read for developers and data engineers looking to optimize their data pipelines. Learn how Conduit is setting a new standard for real-time data movement and how you can leverage these improvements today! 🚀
By Lovro Mažgon
29 Jan 2025
We made it, Conduit v0.11 is here! In this latest release, we’ve focused on adding schema support, enabling you to detect schema changes and retain type information end-end.
By Lovro Mažgon
19 Aug 2024
Explore batching in Conduit connectors for improved data pipeline performance. Understand how it boosts throughput and scalability.
By Lovro Mažgon
23 Aug 2023
Connector Middleware improves the developer experience. You can utilize middleware provided by the SDK to enrich the functionality of connectors without reinventing the wheel.
By Lovro Mažgon
5 Oct 2022
We faced challenges with Protobuf, so we began looking for a resolution... enter Buf!
By Lovro Mažgon
7 Jul 2022
