DEV Community πŸ‘©β€πŸ’»πŸ‘¨β€πŸ’»

DEV Community πŸ‘©β€πŸ’»πŸ‘¨β€πŸ’» is a community of 967,911 amazing developers

We're a place where coders share, stay up-to-date and grow their careers.

Create account Log in
Timothy Spann.   πŸ‡ΊπŸ‡¦
Timothy Spann. πŸ‡ΊπŸ‡¦

Posted on • Originally published at datainmotion.dev on

FLaNK: Low Code Streaming: Populating Kafka Topics with FlinkSQL Joins in Real-Time


FLaNK: Low Code Streaming: Populating Kafka Topics with FlinkSQL Joins in Real-Time

FLaNK

Then I can create my 3 tables. Two are the source ones to join and the third is the destination for my insert.

INSERT INTO global_sensor_events

SELECT

scada.uuid,

scada.systemtime ,

scada.temperaturef ,

scada.pressure ,

scada.humidity ,

scada.lux ,

scada.proximity ,

scada.oxidising ,

scada.reducing ,

scada.nh3 ,

scada.gasko,

energy.current,

energy.voltage ,

energy.power ,

energy.total,

energy.fanstatus

FROM energy,

 scada

WHERE

scada.systemtime = energy.systemtime;

Examples

https://github.com/tspannhw/meetup-sensors/blob/master/flink-sql/

Assets / Scripts / DDL / SQL

https://github.com/tspannhw/FlinkSQLDemo

Flink Guide to SQL Joins
https://www.youtube.com/watch?v=5AuBlVRKQuo

Slides

https://www.slideshare.net/bunkertor/time-series-analysis-dataflow

Article on Joins

https://www.datainmotion.dev/2020/05/flink-sql-preview.html

Resources

Top comments (0)

Update Your DEV Experience Level:

Settings

Go to your customization settings to nudge your home feed to show content more relevant to your developer experience level. πŸ›