Streaming SQL Engine: Lightweight Cross-Data Source Integration for Resource-Constrained Environments.

One month ago, I shared how we deployed a streaming SQL engine that lets you many data sources using standard SQL syntax.

Original post is here:

https://dev.to/theodore_p_9749548f7dd03/how-i-built-a-python-library-that-lets-you-join-mysql-postgresql-mongodb-rest-apis-and-files-in-h5d

Today, I want to present our research paper: "Streaming SQL Engine: Lightweight Cross-Data Source Integration for Resource-Constrained Environments."

Read it here:

https://github.com/Ierofantis/streaming_sql_engine/blob/master/Streaming_SQL_Engine_Paper.pdf

The problem we aimed to solve is simple: many organizations need ETL and big data capabilities without the overhead of heavy infrastructure.

Not every team can spin up large compute clusters or dedicate substantial resources to data pipelines.

Our solution is a streaming, iterator-based SQL engine optimized for memory efficiency and cross-source integration.

This work isn’t about claiming the "fastest" solution, it’s about providing a practical, optimized tool that solves real problems for teams with limited resources.

All comparisons are transparent, with fair benchmarks.

I believe the best solutions come from honest evaluations of trade-offs, not marketing hype.