DEV Community

lnc profile picture

lnc

I’m currently working on the ways in which mature open source ecosystems like Apache Spark and Apache Iceberg shape agent developer experience, and how these projects evolve over time.

Location san francisco, ca Joined Joined on  Personal website https://systemsnull.net/ github website

Work

Developer Relations at Databricks

Building a Spark Connect Client in OCaml because I'm crazy and you're not

Building a Spark Connect Client in OCaml because I'm crazy and you're not

Comments
21 min read

Want to connect with lnc?

Create an account to connect with lnc. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
Hosting an Entire Open Lakehouse on Port 8080

Hosting an Entire Open Lakehouse on Port 8080

Comments
33 min read
All About Iceberg's File Format API: simplifying the engine/format interface and Parquet's multimodal future

All About Iceberg's File Format API: simplifying the engine/format interface and Parquet's multimodal future

Comments
25 min read
An Idiot's Guide to Spark Connect Clients

An Idiot's Guide to Spark Connect Clients

1
Comments
18 min read
Spark's Modules, Seen Through Spark Connect

Spark's Modules, Seen Through Spark Connect

Comments
17 min read
AUTO_CDC: Turning an event log into current state with Spark Declarative Pipelines

AUTO_CDC: Turning an event log into current state with Spark Declarative Pipelines

1
Comments 3
9 min read
Explaining the Python-JVM Boundary in Spark, and What Arrow Changed

Explaining the Python-JVM Boundary in Spark, and What Arrow Changed

1
Comments
14 min read
Most PySpark Tuning Advice Starts in the Wrong Place

Most PySpark Tuning Advice Starts in the Wrong Place

1
Comments
11 min read
Stop Blaming Serialization for Slow Python UDFs

Stop Blaming Serialization for Slow Python UDFs

1
Comments 1
8 min read
How to Build an Open Lakehouse on Your Laptop

How to Build an Open Lakehouse on Your Laptop

Comments
42 min read
loading...