<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Samuel Ramos</title>
    <description>The latest articles on DEV Community by Samuel Ramos (@samuel_ramos_123).</description>
    <link>https://dev.to/samuel_ramos_123</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4002602%2F38d7225b-19c4-411a-99d1-1193c6fd79a5.png</url>
      <title>DEV Community: Samuel Ramos</title>
      <link>https://dev.to/samuel_ramos_123</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/samuel_ramos_123"/>
    <language>en</language>
    <item>
      <title>I built a free, local-first ETL tool in Rust — describe the pipeline in English, drop into SQL or Python - Odara</title>
      <dc:creator>Samuel Ramos</dc:creator>
      <pubDate>Mon, 06 Jul 2026 15:55:14 +0000</pubDate>
      <link>https://dev.to/samuel_ramos_123/i-built-a-free-local-first-etl-tool-in-rust-describe-the-pipeline-in-english-drop-into-sql-or-3cbm</link>
      <guid>https://dev.to/samuel_ramos_123/i-built-a-free-local-first-etl-tool-in-rust-describe-the-pipeline-in-english-drop-into-sql-or-3cbm</guid>
      <description>&lt;p&gt;Every ETL tool I've used forces a trade-off.&lt;/p&gt;

&lt;p&gt;The visual ones (Talend, Informatica, NiFi) are approachable but heavy — a JVM, a licensing conversation, and a wall the moment you need logic the UI didn't anticipate. The code-first ones are the opposite: total control, but you're writing boilerplate and wiring connectors before you've moved a single row.&lt;/p&gt;

&lt;p&gt;I wanted the middle. Sketch the shape of a pipeline visually, and the instant I need real logic, drop into SQL or Python &lt;strong&gt;in the same canvas&lt;/strong&gt; — no context switch, no export-to-code, no JVM. So I built it.&lt;/p&gt;

&lt;p&gt;It's called &lt;strong&gt;Odara&lt;/strong&gt;. It's free, it runs locally on your machine, and the engine is Rust + Apache DataFusion. Here's what it actually does.&lt;/p&gt;

&lt;h2&gt;
  
  
  Describe the pipeline, get the nodes
&lt;/h2&gt;

&lt;p&gt;The part I use most: type the goal in plain English and let the AI assistant draft an ordered list of typed nodes. It doesn't generate a black box — it proposes real, editable nodes you review before they hit the canvas.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fdpurw8s4rsldohd3sep0.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fdpurw8s4rsldohd3sep0.png" alt="AI Assistant composing a pipeline from a plain-English description" width="799" height="437"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;&lt;em&gt;"Read orders from PostgreSQL, keep completed, total revenue by category &amp;amp; month, write to Snowflake"&lt;/em&gt;&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;...becomes a Postgres source → filter → SQL aggregation → Snowflake target. You review it, tweak it, run it. The assistant works with DeepSeek, Anthropic/Claude, Gemini, or any OpenAI-compatible provider — you bring your own key, nothing is hardcoded to one vendor.&lt;/p&gt;

&lt;p&gt;The AI is a starting point, not a cage. Which matters, because the next thing you'll want to do is edit.&lt;/p&gt;

&lt;h2&gt;
  
  
  Visual when you want it, code when you need it
&lt;/h2&gt;

&lt;p&gt;Each node is one small, single-purpose block — a source, a transform, a target. You wire them on a React Flow canvas.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F84gqhj30bqanxint2f1k.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F84gqhj30bqanxint2f1k.png" alt="Visual pipeline editor with typed source, transform, and target nodes" width="800" height="456"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;The transforms are where the "polyglot" idea pays off:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;SQL transforms&lt;/strong&gt; run on &lt;strong&gt;DataFusion&lt;/strong&gt; — Apache Arrow-native, Rust-native, no external database needed to compute a join or an aggregation.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Python transforms&lt;/strong&gt; run in a subprocess with &lt;strong&gt;PyArrow&lt;/strong&gt; for the data hand-off, so you get pandas/numpy/whatever-you-need without the engine leaving Rust.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;You can mix both in one pipeline. A SQL block to aggregate, a Python block to hit some library SQL can't express, another SQL block to shape the output. Data moves between them as Arrow &lt;code&gt;RecordBatch&lt;/code&gt; the whole way — no CSV round-trips between steps.&lt;/p&gt;

&lt;h2&gt;
  
  
  The connectors you actually reach for
&lt;/h2&gt;

&lt;p&gt;Sources and targets covered out of the box:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Databases:&lt;/strong&gt; PostgreSQL, MySQL, Oracle, SQL Server, MongoDB, Snowflake, DB2, generic ODBC&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Files:&lt;/strong&gt; CSV, Excel, XML, and a "Magic File" node that auto-detects the format&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Cloud storage:&lt;/strong&gt; S3, Google Drive, Azure Blob&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Transfer:&lt;/strong&gt; FTP / SFTP / FTPS&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;APIs:&lt;/strong&gt; REST source (GET with pagination, auth, retry) and REST target (POST/PUT/PATCH with batching)&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Streaming:&lt;/strong&gt; Kafka, RabbitMQ, NATS, MQTT with window/aggregate/join operators&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;There's also a Talend-&lt;code&gt;tMap&lt;/code&gt;-style &lt;strong&gt;Mapper&lt;/strong&gt; node — N inputs, M outputs, joins, and per-field expressions — for the mapping-heavy work that's painful to express any other way.&lt;/p&gt;

&lt;h2&gt;
  
  
  Running and watching it
&lt;/h2&gt;

&lt;p&gt;Pipelines execute with live progress over SSE. The monitor shows status, duration, and row counts per run, and it doesn't hide failures — a failed connector or a broken conditional branch shows up red with the actual error.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fakit309a09fp8bfeiubc.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fakit309a09fp8bfeiubc.png" alt="Execution monitor with live status, durations, and row counts" width="800" height="456"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;For anything bigger than a single pipeline, an orchestration layer (&lt;strong&gt;Maestro&lt;/strong&gt;) runs pipelines in parallel, in series, or conditionally. And everything's versioned with &lt;strong&gt;Git&lt;/strong&gt; — pipelines are just definitions, so you branch and diff them like code.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why Rust
&lt;/h2&gt;

&lt;p&gt;Because the boring answer is the real one: no JVM means no multi-hundred-MB runtime and no GC pauses mid-load. The whole thing is a native binary that starts fast and stays light. Execution supports proper cancellation via &lt;code&gt;CancellationToken&lt;/code&gt;, jobs persist in SQLite (WAL mode), and connection credentials are encrypted at rest with AES-GCM.&lt;/p&gt;

&lt;p&gt;It's &lt;strong&gt;local-first&lt;/strong&gt; by default — your data and your pipelines stay on your machine. Nothing gets shipped to a cloud you didn't choose.&lt;/p&gt;

&lt;h2&gt;
  
  
  Where it's at, honestly
&lt;/h2&gt;

&lt;p&gt;If you've ever wanted the approachability of a visual ETL tool without the JVM tax and the licensing dance — or you just want to describe a pipeline in a sentence and get real, editable SQL — I'd genuinely love your feedback.&lt;/p&gt;

&lt;p&gt;Try it: &lt;strong&gt;&lt;a href="https://odara.rs" rel="noopener noreferrer"&gt;https://odara.rs&lt;/a&gt;&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;What's the one ETL pain point you'd want a tool like this to kill first? Drop it in the comments — I'm building against real workflows, not a roadmap in a vacuum.&lt;/p&gt;

</description>
      <category>dataengineering</category>
      <category>rust</category>
      <category>etl</category>
      <category>ai</category>
    </item>
  </channel>
</rss>
