#Data Streaming Posts

Hero

Real-Time AI Made Simple: How Meroxa and Databricks Work Together

Whether you’re building recommendation engines, fraud detection systems, or dynamic pricing models, real-time data powers smarter and faster decisions. For Databricks users, the platform already excels at advanced analytics and AI. Pair it with Meroxa’s seamless, cost-effective real-time data ingestion and transformation capabilities to unlock the full potential of real-time AI workflows. Together, Meroxa and Databricks simplify complex streaming architectures, enabling accurate insights and faster business outcomes without the usual headaches or costs.

By  DeVaris Brown

 21 Jan 2025

CTO HERO

Building a Future-Proof Data Architecture: A CTO’s Guide

Discover how CTOs can tackle fragmented data, scalability, compliance, and vendor lock-in challenges. This blog highlights how Meroxa’s Conduit Platform enables real-time data integration, optimized costs, and innovation-ready architectures to future-proof your enterprise.

By  DeVaris Brown

 16 Jan 2025

Hero

Building Your First Real-Time Pipeline with Meroxa's Conduit OSS: A Step-by-Step Guide

This blog provides a comprehensive, beginner-friendly guide to building your first real-time data pipeline using Meroxa’s open-source Conduit platform. Designed to simplify real-time data integration, Conduit empowers developers to move data seamlessly between systems with minimal setup. The guide walks readers through the installation, initialization, pipeline configuration, and execution steps. Starting with a sample pipeline that streams generated data to a destination file, it showcases Conduit’s intuitive configuration process and highlights the flexibility to handle structured, scalable data in real time. By the end, readers will have a fully functioning pipeline ready to deliver actionable insights and the foundational knowledge to explore advanced configurations. Whether you're new to real-time data or looking for a reliable integration tool, this guide demonstrates how Conduit makes real-time pipelines accessible to everyone.

By  Dion Keeton

 13 Jan 2025

Hero

Building Your First Real-Time Pipeline with Meroxa's Conduit OSS: A Step-by-Step Guide

This blog provides a comprehensive, beginner-friendly guide to building your first real-time data pipeline using Meroxa’s open-source Conduit platform. Designed to simplify real-time data integration, Conduit empowers developers to move data seamlessly between systems with minimal setup. The guide walks readers through the installation, initialization, pipeline configuration, and execution steps. Starting with a sample pipeline that streams generated data to a destination file, it showcases Conduit’s intuitive configuration process and highlights the flexibility to handle structured, scalable data in real time. By the end, readers will have a fully functioning pipeline ready to deliver actionable insights and the foundational knowledge to explore advanced configurations. Whether you're new to real-time data or looking for a reliable integration tool, this guide demonstrates how Conduit makes real-time pipelines accessible to everyone.

By  Dion Keeton

 13 Jan 2025

Hero

Solution Use Case: Accelerating AI/ML Success with Meroxa and Databricks

This blog highlights how integrating Meroxa for real-time data ingestion and Databricks for scalable processing transforms AI/ML workflows. This solution reduces data latency to under 30 seconds, accelerates model training from 48 to 6 hours, and boosts prediction accuracy by 23%. With automated pipelines and end-to-end integration, businesses save time, scale efficiently, and achieve tangible outcomes like improved customer engagement and increased revenue from real-time insights.

By  Dion Keeton

 10 Jan 2025

Tiny data models

Why Bigger Isn’t Always Better: The Case for Ditching LLMs in Favor of Tiny Models Powered by Real-Time Data

In the rapidly evolving world of AI, businesses are discovering that the future lies not in massive, general-purpose language models (LLMs) but in tiny, specialized models powered by real-time data streams. These domain-specific models offer dramatic cost savings, enhanced accuracy, and reduced hallucinations by continuously learning from live business data. From customer support to financial services and supply chain management, tiny models excel in delivering precise, actionable insights tailored to specific operations. Powered by platforms like Meroxa, which enables robust real-time data infrastructure, this approach bridges the gap between AI capabilities and business needs, providing a sustainable, efficient path to enterprise AI innovation.

By  DeVaris Brown

 18 Dec 2024

hero

Government IT Modernization with Meroxa: Accelerate Your Digital Transformation

In this blog, discover how Meroxa empowers governments to overcome the challenges of IT modernization with real-time data integration, cost-effective solutions, and secure, scalable infrastructure. Learn how Meroxa helps transform aging systems into agile, efficient platforms that meet the growing demands of today’s tech-savvy constituents. Explore real-world success stories, actionable insights, and innovative strategies to deliver better services, reduce costs, and improve transparency—without sacrificing security or control. Whether you're managing federal programs, state services, or local initiatives, Meroxa enables you to reimagine government operations at the speed of innovation.

By  Dion Keeton

 5 Dec 2024

THN hero

Case Study: Streamlining Data Flow for The Hotels Network with Meroxa

The Hotels Network (THN) partnered with Meroxa to streamline data flow between their sales and support teams, overcoming siloed data and complex architecture challenges. Using Meroxa’s Conduit Platform, THN achieved a unified, real-time pipeline from Salesforce to Redpanda, reducing operational costs by 30% and enhancing customer support capabilities. The solution’s scalability ensures THN can continue to grow and optimize operations seamlessly.

By  Dion Keeton

 13 Nov 2024

conduit hero

Conduit Operator v0.02 with Schema Registry Support!

We’re excited to introduce the latest update to the **Conduit Operator**, now with built-in **schema registry support**. This new feature allows seamless data encoding and decoding, improving data compatibility across your pipelines. Whether you're managing multiple Conduit instances or scaling your data operations, schema registry integration ensures a smoother, more reliable experience for handling complex data flows.

By  Lyubo Kamenov

 25 Oct 2024

Pipeline Recovery

Unlocking Resilience: Conduit v0.12.0 Introduces Pipeline Recovery

The Conduit team has just released Conduit v0.12, and we're gearing up for the launch of Conduit v1 with a focus on making pipelines more resilient. One key feature of this release is pipeline recovery, designed to automatically restart pipelines that experience temporary errors like network interruptions or service downtime. With configurable backoff settings, Conduit can efficiently handle retries, reducing the impact of transient issues. Learn more about this feature and how it ensures your pipelines are always up and running.

By  Haris Osmanagić

 11 Oct 2024

Conduit Platform

Announcing the New Conduit Platform by Meroxa

We are thrilled to introduce our latest offering, the Conduit Platform, which brings a host of new features and improvements designed to enhance your real-time data streaming experience, now powered by our robust Conduit open-source core. This transformation brings enhanced performance, scalability, and usability, coupled with access to over 100 connectors maintained by our dedicated open-source community. Here’s a closer look at what’s new and how it can benefit your data operations.

By  Dion Keeton

 18 Jun 2024