FGN-3596 Taming IoT Data: Making Sense of Sensors with SQL Streaming | Voxxed Days

Voxxed Days Zurich 2019
on Tuesday 19 March

   Taming IoT Data: Making Sense of Sensors with SQL Streaming


Big Data & Machine Learning
Big Data & Machine Learning
Intermediate level
Room 6 Tuesday from 16:40 til 17:30

We are living in a data streaming era, yet until recently it has been particularly hard to leverage existing stream processing technologies. On the one hand, because dealing with data in motion has its inherent challenges. On the other hand, most frameworks and APIs which are allowing for stream processing are typically very hard to employ and/or operate - NOT so for KSQL, the newest kid in Apache Kafka's ecosytem. Based on a simplified version of an IoT use case this session gives a gentle introduction into KSQL - Kafka's SQL streaming engine for the masses.

Join this whirlwind tour during which we are discussing a fully-fledged streaming IoT architecture. Concretely, we are going to:

(1) ingest smart home energy data into Apache Kafka, (2) use KSQL for flexible, powerful and scalable SQL-only stream processing, (3) send raw data as well as pre-processed results to an operational NoSQL data store, (4) reactively serve data to clients in near real-time and (5) finally build informative live charts.

Stream Processing   IoT architectures   Kafka   SQL   sensor data  
Subscribe to Voxxed Days on YouTube
Hans-Peter Grahsl
Hans-Peter Grahsl

Hans-Peter is working as technical trainer for Java Web Development and is responsible for the internal education department at NETCONOMY Software & Consulting GmbH in Graz, Austria. As an independent trainer and consultant he is supporting customers during the conception and implementation of on-prem or cloud-based data architectures using modern technology stacks and NoSQL data stores. Hans-Peter is also an associate lecturer for Software Engineering at CAMPUS 02 University of Applied Sciences.

Make sure to download the Android or iOS mobile schedule.