FLaNK: Low Code Streaming: Populating Kafka Topics with FlinkSQL Joins in Real-Time

FLaNK: Low Code Streaming: Populating Kafka Topics with FlinkSQL Joins in Real-Time

Then I can create my 3 tables. Two are the source ones to join and the third is the destination for my insert.

INSERT INTO global_sensor_events

SELECT

scada.uuid,

scada.systemtime ,

scada.temperaturef ,

scada.pressure ,

scada.humidity ,

scada.lux ,

scada.proximity ,

scada.oxidising ,

scada.reducing ,

scada.nh3 ,

scada.gasko,

energy.current,

energy.voltage ,

energy.power ,

energy.total,

energy.fanstatus

FROM energy,

 scada

WHERE

scada.systemtime = energy.systemtime;

Examples

https://github.com/tspannhw/meetup-sensors/blob/master/flink-sql/

Assets / Scripts / DDL / SQL

https://github.com/tspannhw/FlinkSQLDemo

Flink Guide to SQL Joins
https://www.youtube.com/watch?v=5AuBlVRKQuo

Slides

https://www.slideshare.net/bunkertor/time-series-analysis-dataflow

Article on Joins

https://www.datainmotion.dev/2020/05/flink-sql-preview.html

Resources

• https://github.com/cloudera/flink-tutorials
• https://docs.cloudera.com/csa/1.1.0/job-lifecycle/topics/csa-run-job.html
• https://github.com/asdaraujo/edge2ai-workshop/tree/master/flink
• https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/sqlClient.html
• https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/table/sqlClient.html