Flo.w

# Real-Time Ingest Overview

Flo.w Real-Time integrates with Flo.w Engine to support high-volume, low-latency ingest of real-time data.

Real-time ingest uses the MQTT messaging protocol to deliver data to Flo.w. MQTT is a lightweight publish/subscribe messaging transport used in many IoT applications, and a wide variety of industries, such as automotive, manufacturing, telecommunications, oil and gas. See mqtt.org (opens new window) for further details.

# Architecture

The diagram below illustrates Flo.w Real-Time within the Flo.w ecosystem. Real-time data flow is indicated by bold arrows. The key components are:

  • The MQTT Broker - provides an MQTT endpoint for receiving real-time data.
  • The MQTT Ingester - subscribes to the MQTT broker and performs data ingest.

The MQTT Broker uses Flo.w Engine authentication services to authenticate MQTT connections. The MQTT Ingester reads dataset metadata from Flo.w Engine and writes directly to the databases that provide dataset backing-storage to maximize ingest performance.

MQTT Architecture

For further details see:

← MQTT Ingest Endpoint →