Real-time SQL Server Change Data Capture (CDC)
Microsoft SQL Server is a powerful, widely used relational database management system. Today, we’re releasing a public beta version of our Microsoft SQL Server as a source for real-time data streams.
As a source, you can build pipelines that act on changes from SQL Server. For example, you can:
- Extract Transform Load (ETL) into a Data Warehouse.
- Real-time replication and sync to other data stores.
With Meroxa, it’s all streaming, real-time, and your pipelines will be up and running in minutes not months.
Getting Started
To begin sending data to SQL Server, perform the following steps:
- Create an Account — By using thedashboard, or the CLI.
- Setup —Configure your Microsoft SQL Server instance and acquire the credentials needed to talk to Meroxa.
- Add Resource — Use thedashboard or
[meroxa resource create](https://docs.meroxa.com/cli/cmd/meroxa-resources-create)
command to add to your Meroxa Resource Catalog.
SQL Server Source Connector
As a source, you can capture changes from SQL Server and send toAmazon Redshift, Webhooks, Amazon S3 or any other destination.
The SQL Server source is a CDC connector that leveragesSQL Server transaction log, which contains a list of every change events. This connector will perform an initial snapshot of the data. Then, it will stream everyINSERT
,UPDATE
,DELETE
operation and push the events into a Meroxa stream.
This connector will emit data records in the following format:
To create a source, you can use thedashboard ormeroxa resource create
command to create a new connector:
meroxa resource create mysqlserver \--type sqlserver \--url "sqlserver://$MSSQL_USER:$MSSQL_PASS@$MSSQL_URL:$MSSQL_PORT/$MSSQL_DB"
For more, seeMicrosoft SQL Server Documentation.
I can’t wait to see what you build 🚀
The SQL Serverconnector is currently in beta. We encourage customers to start using the connector in their staging and development environments and provide feedback. Following the beta phase, we will make the connector generally available for use in all environments (dev, staging, and production). Meroxa follows this pattern for all connectors that it releases to ensure a great experience for you.
As always,
- If you need help, reach out tosupport@meroxa.io
- Join ourDiscord community.
- Follow us onTwitter.