Meroxa is committed to making real-time data engineering simple. Part of this is giving you access to the databases engineers use most. Today, we’re happy to announce that MySQL, one of the most popular open-source databases for developers, is now in public beta as a source and destination for real-time data streams.
As a source, you can build pipelines that act on changes from MySQL. For example, you can:
As a destination, you can capture events from PostgreSQL, Elasticsearch, or any other Meroxa source and send them to MySQL.
With Meroxa, it’s all streaming, real-time, and your pipelines will be up and running in minutes, not months.
To begin sending data to MySQL, perform the following steps:
meroxa resource createcommand to add to your Meroxa Resource Catalog.
Then, you can start building pipelines.
As a source, you can capture changes from MySQL and send them to Redshift, Webhooks, Amazon S3, or any other destination.
The MySQL source is a CDC connector that leverages MySQL’s Binary Log. The binary log contains a list of every change event of a given MySQL instance. This connector will perform an initial snapshot of the data. Then, it will stream every
DELETE operation and push the events into a Meroxa stream.
This connector will emit data records in the following format:
meroxa connector create from-mysql-connector \
--from my-mysql \
--input Users \
For more, see MySQL Source Connector Documentation.
As a destination, you can capture events from a Meroxa source and send them to tables in MySQL.
meroxa connector create to-mysql-connector \
--from my-mysql \
--input $STREAM_NAME \
For more, see MySQL Connector Documentation.
I can’t wait to see what you build. 🚀
The MySQL connector is currently in beta. We encourage customers to start using the connector in their staging and development environments and provide feedback. Following the beta phase, we will make the connector generally available for use in all environments (dev, staging, and production). Meroxa follows this pattern for all connectors that it releases to ensure a great experience for you.