Code-First Application Platform Blog & Insights

15 Nov 2023

Conduit 0.8 is here

Conduit 0.8 more than doubles single-pipeline performance.

Real-Time, Real Fast: Supercharging Data Pipelines with Conduit & Redpanda

Revamp your data pipelines with Conduit and Redpanda! Swap Kafka and Kafka Connect complexities for a swift, user-friendly options.

By Kevin Marsh

28 Aug 2023

Conduit Accredited in Iron Bank DoD Centralized Artifacts Repository

Visit conduit.io to download and learn how to use Conduit, the secure and efficient open-source data integration tool accredited by the DoD Iron Bank.

By Lovro Mažgon

23 Aug 2023

Harnessing the Power of Batching in Conduit Connectors

Explore batching in Conduit connectors for improved data pipeline performance. Understand how it boosts throughput and scalability.

By Rimas Silkaitis

19 Jul 2023

Conduit 0.7

Conduit 0.7 gets us one step closer to being a full functioning, feature rich alternative to Kafka Connect.

Building Streaming Data Connectors Faster with OpenAI’s GPT-4

Learn how OpenAI's GPT-4 has helped to streamline data connector building for Meroxa, reducing development time and effort.

By Sara Menefee

24 May 2023

Spire Maritime AIS Source Data Integration now Generally Available

The Spire Maritime AIS source data integration is the first of its kind. It works natively with Meroxa's stream processing data platform.

By Keith Haller

16 May 2023

Is Volatility “swamping” Your Data Discovery?

Meroxa enables big data projects to evolve with business needs and address data volatility challenges.

By Jennifer Hudiono

9 May 2023

Turbine + Self-Hosted Environments: Data Isolation For Streaming Apps

Choosing between speed and compliance is hard. Meroxa eliminates implementation complexity while still offering complete control of your data.

Confluent time to value curve with Meroxa

By Keith Haller

27 Apr 2023

Build Real-Time Data Apps Faster with Confluent + Meroxa

Learn how Meroxa's data platform can improve your time to value and enhance your experience when working with Confluent.

By Rimas Silkaitis

25 Apr 2023

Liberate Your Data from Vendor Lock-in with Meroxa

Meroxa helps you liberate your company's data so you can avoid vendor lock-in.

By Rimas Silkaitis

11 Apr 2023

Introducing Conduit 0.6

Conduit 0.6, is full of features and bug fixes that will help developers as they operate Conduit in production environments.

If Data is the New Oil, Why isn't Data a Commodity?

Because of Meroxa's revolutionary code-first strategy, Meroxa is the only independent streaming integration provider that frees you from vendor lock-in.

By Sara Menefee

15 Mar 2023

Announcing the Oracle Database Source Data Integration

Ingest, transform & stream data from your Oracle Database with Meroxa in a few lines of code.

By Eric Cheatham and Tanveet Gill

3 Mar 2023

Medallion Architecture + Meroxa: Easily Work with Massive Amounts of Data

Learn how to implement the Medallion Architecture using Meroxa to streamline analytics and make it easier to work with large amounts of data.

By Uchenna Anyanwu

28 Feb 2023

Conduit 0.5 is Now Available

Conduit 0.5: We made an easy-to-configure Dead Letter Queues (DLQ) through HTTP & gRPC, extending health checking, & adding capabilities with Debezium records.

By Tanveet Gill

22 Feb 2023

Transformation Part I: Using Meroxa & Google Maps API to enrich & load data into Snowflake in Real-Time

Learn how to use the Meroxa Platform along with the Turbine Framework to transform, enrich, orchestrate, & analyze data in real-time.

By Anna Khachaturova

7 Feb 2023

Journey to IR: How Meroxa Improved Stream Processing App Efficiencies

Learn how Meroxa used Intermediate Representation (IR) to improve stream processing application efficiencies.

By Tanveet Gill

2 Feb 2023

Optimize and Realize Value in Snowflake with Meroxa

With Meroxa, companies optimize Snowflake storage, compute, operational costs and make their developers much more productive.

Diagram of the Turbine Data Streaming App Deployed on the Meroxa Platform

By Simon Lawrence

25 Jan 2023

Save Money on Workato and Gain Real-Time Data Streaming with Meroxa

Meroxa saved money by replacing Workato with a Turbine data app which allows you to quickly sync, persist, and transform data between data infrastructures.

By Jennifer Hudiono

24 Jan 2023

Introducing Turbine Ruby

Now Ruby developers can stream Meroxa on Ruby. Meroxa is stream processing application PaaS.

Conduit 0.4

Conduit is a tool to help developers build streaming data pipelines between production data stores and messaging systems.

Sync, Transform, & Migrate data in Real-Time from PostgreSQL to MongoDB w/ Meroxa

Real-time data sync, transformation & migration from PostgreSQL to MongoDB using Meroxa with Change Data Capture (CDC).

By Sara Menefee

8 Dec 2022

Introducing Visualized Turbine Applications

Visualizing the Turbine data app provides insight into the runtime details of the application’s components on the platform.

By Tanveet Gill

6 Dec 2022

Streaming changes in real-time from MongoDB to Apache Kafka

Learn how to efficiently pull data out of MongoDB in real-time using a Meroxa Turbine data stream processing app.

By Jennifer Hudiono

1 Dec 2022

Meroxa Now Streaming on Ruby

Combining Ruby’s simplicity and power with Turbine, Rubyists can now build data streaming apps with development workflows you know and love.

By Tanveet Gill

18 Nov 2022

Using Turbine to call multiple APIs in real-time to transform & enrich data

Use Meroxa Turbine to call multiple APIs in real-time to transform & enrich your data via Clearbit, Apollo and Hubspot

By Tanveet Gill

8 Nov 2022

Real-Time Data Streaming from PostgreSQL to Apache Kafka in 4 Lines of Code w/ CDC

Stream data from PostgreSQL to Apache Kafka using four lines of code with change data capture.

By Haris Osmanagić

3 Nov 2022

Testing the Limits: Performance Benchmarks for Conduit

We decided to build a performance benchmark for Conduit early, so we could determine how much it can handle and what it takes to break it.

By Diana Doherty

3 Nov 2022

Welcome to Meroxa: Your First Month at Meroxa as an Engineer

Starting a new job can feel like drinking from a firehose for the first few weeks. Meroxa has engineered the onboarding process to help create a smooth transition.

By Jennifer Hudiono

1 Nov 2022

Introducing Collaboration for the Meroxa Platform

With Meroxa’s newest feature, developers can now easily invite their teammates to their account to share resources and build data applications together.

By Raúl Barroso

11 Oct 2022

How We Built our Meroxa CLI

Building and maintaining a CLI is a daunting task if you don’t have some guidance along the way. We identified some best practices to help you.

Middleware for Conduit Connectors Improves Developer Experience

Connector Middleware improves the developer experience. You can utilize middleware provided by the SDK to enrich the functionality of connectors without reinventing the wheel.

By Rimas Silkaitis

27 Sep 2022

Announcing Conduit 0.3

Conduit is a tool that helps developers move data within their infrastructure to the places they’re needed.

Bringing Continuous Delivery to Kafka & Streaming Data Apps

Bringing continuous delivery to Kafka and streaming data apps with Apache Kafka Connector and Feature Branch Deploys.

By Sara Menefee

14 Sep 2022

Turbine Feature Branch Deploys

Data apps may undergo several code changes during the development lifecycle. Feature branches allow developers to branch off the main or production instance of the data app code without impacting production code.

By Jennifer Hudiono

14 Sep 2022

New Integration Resources: Apache Kafka and Confluent Cloud

We are taking an important step towards helping customers build data applications with support for Apache Kafka as a resource on Meroxa.

By Rimas Silkaitis

6 Sep 2022

Log & Metric Experiences Matter for Streaming Data

The opportunity to delight someone using your tool can happen at any time. The open-source Conduit project team makes the user experience a top priority.

By DeVaris Brown

1 Sep 2022

Real-Time Analytics Using the Kappa Architecture in ~20 Lines of Code with Turbine, Materialize, Spark, & S3

Real-Time Analytics Using the Kappa Architecture in ~20 Lines of Code with Turbine, Materialize, Spark, & S3.

By Jesse Jordan

29 Aug 2022

Better Test User Interactions in JavaScript Apps with Emulated Events

When automated testing of JavaScript apps, it is key to verify the app state is changing as expected. By emulating the DOM events in automated tests, you get closer to mimicking the app’s behavior accurately.

By DeVaris Brown

25 Aug 2022

Prospector: Turbine Data App for Generating Qualified Sales Leads

Using Turbine to build a data app to help source new sales leads helps small sales teams scale.

By Co-authored by Meroxa and thatDot

17 Aug 2022

Real-Time Fraud Detection with Turbine and Novelty Detector

What if you could easily access and use categorical data to detect dangerous anomalies? With Turbine and thatDot Novelty Detector, you can.

By DeVaris Brown

4 Aug 2022

Real-Time Data Enrichment for Data Activation Using Meroxa Turbine and Clearbit

By using Meroxa’s Turbine SDK, you can simplify the data activation process by reducing the need to use multiple point solutions for transformation and reverse ETL with code.

By Haris Osmanagić

2 Aug 2022

Using Conduit to Generate Fake Data for Streaming Systems

Testing streaming systems and architectures can be difficult because you need to mock data and have an upstream system continuously push that mock data. Conduit has made it easier with a built in generator that creates fake data for streaming systems..

By Lovro Mažgon

7 Jul 2022

How Conduit uses Buf to work with Protobuf

We faced challenges with Protobuf, so we began looking for a resolution... enter Buf!

By Jane Lombardi

29 Jun 2022

Being a Meroxa Mom

Candidates are often intrigued by perks like unlimited time off and flexible hours. But do those perks actually come through once they land the job?

Juneteenth — The Impact of Misinformation & Action Items for the Workplace

If you want to do more than encourage your employees to spend money at a Black-owned restaurant on Juneteenth, here are some impactful actions your company can make.

By Simon Lawrence

8 Jun 2022

A Tale of Two Apps: Web Apps and Data Apps

A data app is an application that uses real-time or near-real-time events to solve a problem.

By Ali Hamidi

2 Jun 2022

A Proposal for Better Interoperability with Change Data Capture

Change Data Capture (CDC) is a general term for a mechanism that communicates not just the current state of some data in an upstream resource.

By Idalin Bobe

5 May 2022

Hold the Guacamole: Rethinking Cinco de Mayo

Cinco de Mayo is here, and though many people make reservations with friends to eat at their favorite taco spot, let’s take time to honor Mexican heritage.

By DeVaris Brown

20 Apr 2022

Hello Meroxa 2.0

Since launching last April, Meroxa has become the de-facto platform for creating real-time data pipelines for over 300 companies.

Real-time Search Indexing with Turbine and Algolia

Learn how to send and continuously sync data to Algolia using Turbine. With Turbine, you can properly test, review, and build data integrations in a code-first way.

By Taron Foxworth

20 Apr 2022

Real-time eCommerce Order Data Warehousing and Alerting with Turbine

Use Turbine, Meroxa's stream processing application framework, to perform real-time e-commerce Order Data warehousing and alerting.

By Taron Foxworth

20 Apr 2022

Real-time Data Lake Ingestion with Turbine

Turbine offers a code-first approach to building real-time data lake ingestion systems. Build, review, and test data products with a developer's mindset.

By Rimas Silkaitis

20 Apr 2022

Turbine: Putting the “App” in Data App

We’re excited to share the next chapter of Meroxa and what it means for software engineers to build, test and deploy data applications.

By Rimas Silkaitis

5 Apr 2022

Conduit 0.2: Making Connectors a Reality

In this release, Conduit now has an official SDK that will allow developers to build connectors for any data store.

By Taron Foxworth

24 Mar 2022

Writing Data Integration Software with the Conduit REST API

Since Conduit ships as a tiny single binary, it functions as a powerful tool that allows you to efficiently move data from one place to another.

By Lyric Hartley

10 Mar 2022

Deploying Conduit on Heroku

Conduit is a tool to move data around and Heroku is an application platform.

Conduit Now and Into the Future

The Conduit roadmap is meant to provide insight into the major bodies of work we want to achieve within any given release.

By Lyric Hartley

25 Feb 2022

“Real-time” is becoming the default expectation. What's holding it back?

The world is trending towards more rapid delivery of goods and services. We use the term “Real-time” to mean that it happens as close to “now” as possible.

By Lyric Hartley

10 Feb 2022

Why Conduit? An evolutionary leap forward for real-time data integration.

Conduit is an open-source project to make real-time data integration easier for developers and operators.

By Taron Foxworth

4 Feb 2022

Where is the modern data stack for software engineers?

The Future of the Modern Data Stack looks excellent for data engineers. But where is the modern data stack for software engineers?

By Taron Foxworth

21 Jan 2022

Conduit: Streaming Data Integration for Developers

We’re open-sourcing Conduit, Meroxa’s data integration tool built to be flexible & extendible, and provide developer-friendly streaming data orchestration.

By Sara Menefee

4 Jan 2022

Introducing Self-Hosted Environments: Bringing Data Isolation to Your Cloud

Today, we’re excited to announce the Self-Hosted Environments Beta.

By Taron Foxworth

6 Sep 2021

How to Obtain a Meroxa Access Token

Step-by-step instructions on how to obtain a Meroxa access token. The Meroxa access token is needed to authenticate to the Meroxa API programmatically.

By Taron Foxworth

1 Sep 2021

Stream Your Database Changes with Change Data Capture: Part Two

Let’s discuss the use cases of CDC and look at the tools that help you add CDC into your architecture.

By Taron Foxworth

19 Aug 2021

Introducing Microsoft SQL Server Connector Beta

Microsoft SQL Server is a powerful, widely used relational database management system. Today, we’re releasing a beta version of our Microsoft SQL Server connector.

By Taron Foxworth

11 Aug 2021

Stream Your Database Changes with Change Data Capture: Part One

Change Data Capture (CDC) is an efficient and scalable model that simplifies the implementation of real-time systems.

By Taron Foxworth

6 Aug 2021

Real-Time Pipelines as Code with the Meroxa Terraform Provider

With the Meroxa CLI and the Meroxa Dashboard, your pipelines are streaming, real-time, and up and running in minutes, not months.

By Taron Foxworth

15 Jul 2021

Securely Communicate to Your Resources With SSH Tunneling

When you build a data pipeline using Meroxa, your data is encrypted in transit and at rest. Today’s platform update adds a new layer of security to Meroxa.

By Taron Foxworth

29 Jun 2021

Introducing MySQL Connector Beta

MySQL, one of the most popular open-source databases for developers, is now in public beta as a source and destination for real-time data streams.

By Taron Foxworth

8 Jun 2021

Creating a Soft Delete Archive Table with PostgreSQL

Postgres Triggers and Functions are powerful features that allow you to listen for DELETE operations that occur within a table and insert the deleted row in a separate archive table.

By Taron Foxworth

10 May 2021

How to Expose PostgreSQL Remotely Using ngrok

Learn how to expose PostgreSQL Remotely Using ngrok. This method allows you to quickly test and analyze the behavior of PostgreSQL with Meroxa.

By Taron Foxworth

5 May 2021

Analyze Change Data Capture from PostgreSQL with Meroxa and Materialize

Analyzing the changes that occur to PostgreSQL will give you insight into the current state of the data and allows you to dig into the changes of your database.

By DeVaris Brown

13 Apr 2021

Hello World, Meroxa Style.

“Data is the new oil.” If data is the new oil, we wanted to power the refinery. The merox process, but for data.