Microsoft SQL Server is a powerful, widely used relational database management system. Today, we’re releasing a public beta version of our Microsoft SQL Server as a source for real-time data streams.
As a source, you can build pipelines that act on changes from SQL Server. For example, you can:
- Extract Transform Load (ETL) into a Data Warehouse.
- Real-time replication and sync to other data stores.
- Build microservices that to respond to Change Data Capture events.
With Meroxa, it’s all streaming, real-time, and your pipelines will be up and running in minutes not months.
To begin sending data to SQL Server, perform the following steps:
- Create an Account — By using the dashboard, or the CLI.
- Setup —Configure your SQL Server instance and acquire the credentials needed to talk to Meroxa.
- Add Resource — Use the dashboard or
meroxa resource createcommand to add to your Meroxa Resource Catalog.
Then, you can check out our guide for SQL Server to begin building pipelines.
SQL Server Source Connector
As a source, you can capture changes from SQL Server and send to Redshift, Webhooks, Amazon S3 or any other destination.
The SQL Server source is a CDC connector that leverages SQL Server transaction log, which contains a list of every change events. This connector will perform an initial snapshot of the data. Then, it will stream every
DELETE operation and push the events into a Meroxa stream.
This connector will emit data records in the following format:
To create a source, you can use the dashboard or
meroxa connector create command to create a new connector:
meroxa connector create from-mssql-connector \\
--from my-mssql \\
--input dbo.Users \\
For more, see SQL Server Connector Documentation.
I can’t wait to see what you build 🚀
The SQL Server connector is currently in beta. We encourage customers to start using the connector in their staging and development environments and provide feedback. Following the beta phase, we will make the connector generally available for use in all environments (dev, staging, and production). Meroxa follows this pattern for all connectors that it releases to ensure a great experience for you.