DEV Community: DataDriven

97% of Data Engineers Are Burned Out. Here's the Data.

DataDriven — Tue, 11 Aug 2026 19:09:27 +0000

I've been through 3 waves of "data engineering is getting automated away." Still here. Still employed. Still debugging the same categories of problems. But I'm going to be honest: this time feels different. Not because the work is disappearing. Because the people doing it are running out of gas.

97% of data engineers report burnout. 70% say they're likely to leave within 12 months. 79% have considered leaving the industry entirely. And those numbers landed in the same cycle as 52,050 tech layoffs in Q1 2026 alone, a 67% collapse in junior postings, and interview loops that stretch 60 to 90 days before you even get a "no."

This isn't anecdote. It's a documented structural problem, and nobody's named it directly.

The 97% Stat Nobody Is Citing Correctly

Let me be upfront about the sourcing, because intellectual honesty matters more than a clean narrative. The 97% burnout figure comes from a 2021 survey of 600 data engineers, commissioned by data.world and DataKitchen, conducted by Wakefield Research. That same survey produced the 70% attrition intent number and the 79% "considered leaving the industry" figure.

5 years old. Not a 2026 measurement.

But here's why I'm not discounting it: the structural forces that produced those numbers in 2021 didn't get better. They got worse. The top burnout drivers identified in that survey were time spent fixing errors, repetitive manual data prep, and constant unrealistic requests from colleagues. 52% felt their company didn't address data quality issues rigorously.

Now layer on 2026 reality. Data engineers spend roughly 50% of their time maintaining legacy pipelines, with an estimated $520K in annual waste per engineer. AI commoditized the boilerplate (staging SQL, scaffolded DAGs, schema mappings) but didn't touch the maintenance burden. It compressed the easy work and left the hard work untouched. Same team, 2x coverage on the syntax tier, zero relief on the judgment tier.

General tech burnout sits at 67% in 2026. Software engineers and DevOps specifically hit 74%. If data engineering was at 97% in 2021 before any of the current pressures existed, I don't have a hard time believing it's stayed there or climbed.

The stat is old. The problem is current.

The Layoff Wave That Hit Data Teams Hardest

Q1 2026 was a bloodbath. 52,050 tech jobs gone before April. By mid-year, over 150,000 tech roles eliminated. And data teams took a disproportionate hit.

Confluent cut 25% of its workforce; 800 employees, immediately after IBM's $11 billion acquisition closed. The largest single reduction in the data infrastructure sector this cycle. Amazon eliminated 16,000+ corporate roles with heavy cuts to AWS professional services, data platform builders, and production-scale engineers. Meta's 10% reduction (8,000 employees, effective May 20) hit engineering hardest: 2,212 engineers cut at HQ alone, with infrastructure and platform teams experiencing what internal communications called "heavy impact." Snowflake has shed roughly 700 positions since February 2024, including 70 technical writers eliminated through "Project SnowWork" automation.

63% of Q1 2026 tech layoffs explicitly cited AI as a factor. Up from 38% in 2025. This isn't the 2023 "efficiency" wave. This one is structurally different.

The paradox: data engineering is a $105 billion market growing 15% annually. 23% hiring growth year over year. 260,000 US openings. And 4 of the 5 largest data platform employers cut thousands of roles in the same breath. The growth went entirely to senior roles. The on-ramp closed.

Meanwhile, Databricks sits at 840+ open roles, zero layoffs, $5.4B annualized revenue, 65% year-over-year growth, and a $134B valuation. Displaced talent from Snowflake and Confluent is landing there almost by default; senior engineers seeing $70K to $80K comp uplifts in the move. One company absorbed the cuts of its competitors and turned layoff season into a talent acquisition play. Silence on layoffs is the messaging. No press release needed when hiring is the narrative.

But here's the part that should worry you: 54% of engineering leaders explicitly plan to hire fewer juniors in 2026, citing AI copilots as the reason senior engineers can cover more ground without backfill. Junior data engineer postings collapsed 67%. Only 3% of open DE jobs are entry-level. Time to first job doubled from 4 months in 2022 to 6 to 12 months in 2026.

The ladder got pulled up. And nobody lowered a rope.

The Interview Gauntlet as Burnout Accelerant

If the layoffs are the wound, the interview process is salt.

Enterprise data engineering hiring now takes 60 to 90 days. 5 to 7 rounds over 4 to 8 weeks. Phone screens, take-home assignments requiring 10 to 20 hours of work (the fairness threshold is under 4), technical onsites running 4 to 6 hours. Google's loop stretches 6 to 12 weeks; the longest of any major tech company. Meta averages 35 days. Snowflake clocks in around 29 days but packs 4 to 5 onsite rounds into that window.

The best candidates leave the market within 10 to 14 days. Dragging the process past 3 weeks guarantees you lose them to someone faster. But companies keep running 60-day loops anyway, because 66% of CEOs are freezing or cutting hiring through end of 2026 while simultaneously running recruitment pipelines. Freezes don't slow hiring; they extend timelines from weeks to indefinite holds. Candidates exhaust themselves in 6-month loops with no closure.

And 48% of visible data engineering roles are ghost jobs. Posted for internal org purposes, headcount justification, or deliberate understaffing. Never actually filled. Nearly half the positions you're applying to don't exist.

I did somewhere around 20 interview loops in a single job search. Some went well. Some went laughably poorly. I got rejected after the first half of an onsite; that one hurt. I did 8 rounds at a company, was told I passed, was told the offer was sent, it was never sent, then a new recruiter said I'd declined the offer I never saw, then I did 4 more rounds, passed again, and the headcount was closed. The process is not designed for candidates. It's designed for companies to feel thorough.

Now imagine running that gauntlet while already burned out from your current job. The interview loop doesn't find the best candidate. It selects for desperation. The person willing to endure a 90-day process while working 50-hour weeks isn't necessarily the most capable engineer; they're the most exhausted one. And they show up to day one already running on empty.

Then there's the AI anxiety layer. Data engineers face 75% theoretical AI exposure but only 37% actual observed impact. The gap between what AI could automate and what organizations have actually automated is enormous. But fear doesn't care about adoption friction. 75% theoretical exposure reads as "my job is 75% automatable" in the brain of someone already burned out, even when the reality is that data quality checks hit 65% automation while warehouse architecture sits at 38%. The dread is real even when the threat isn't fully materialized.

What a Burnout-Proof Data Engineering Career Looks Like Now

The data engineers who survive this cycle aren't the ones who learned the most tools. They're the ones who moved up the stack.

AI compressed the syntax tier of the job. Staging SQL, DAG scaffolding, schema mapping, boilerplate unit tests. That work is commoditized. What's left is the judgment tier: architecture decisions, cost optimization, governance design, debugging the Spark job that silently dropped 40% of records for 6 months before anyone noticed. Nobody automates that. Nobody even knows how to specify it well enough to automate it.

Architecture expertise commands a $20K to $40K salary premium. MLOps and ML pipeline architecture adds 10 to 15% to base. AI governance roles carry premiums up to 35%, with 64% of senior compliance professionals ranking it as the most critical skill over the next 3 years. The money follows judgment, not implementation.

The consulting market tells the same story. Data engineering consulting hit $91.5B in 2025, projected to reach $187B by 2030 at a 15.4% CAGR. That's the fastest-growing exit path for burned-out engineers. Not MLE, not management; consulting. Burned-out DEs are opting out of traditional employment rather than trading one burnout career for another.

For those staying in, the reliable path has shifted. The old on-ramp (bootcamp to junior DE) is functionally dead. The new one is analyst or backend engineer for 12 months, internal transfer to analytics engineer or junior DE, then full DE at month 30. It's slower. It's also the only path that consistently works when 3% of postings are entry-level.

Here's what I'd actually focus on if I were grinding right now. Data modeling; it's still the core skill, and getting the model wrong upstream means everything downstream is pain. Cost optimization, because the $520K annual maintenance waste per engineer is where your value proposition lives. Governance and compliance, because AI Act, DORA, and NIS2 are creating regulatory surface area that needs engineers who understand both the data and the rules. And pipeline architecture, not system design; DEs don't care about load balancers and reverse proxies.

If you're prepping for interviews specifically, that's the whole reason datadriven.io has data engineering interview questions covering the exact patterns that show up in these loops, from SQL and Python to system design and behavioral rounds. Interviewing is a skill. It's separate from the actual job. Treat prep like a job. Do 50 LeetCode mediums and you'll be solid; few companies ask hards consistently. But the real differentiator in 2026 isn't whether you can reverse a linked list. It's whether you can answer "why does this pipeline exist?" for every pipeline you own. Business context beats tool depth every time. The survivors of the layoff waves were the engineers who could articulate that.

Data engineering isn't dying. The $105B market, 36% projected job growth through 2034, and 260,000 US openings make that clear. But the profession is bifurcating violently: senior architects earning $200K+ on one side, and a collapsed junior pipeline with 48% ghost jobs on the other. The middle is hollowing out.

I've watched this industry cycle through "hot new paradigm" phases 3 times now. The tools change every 18 months. The problems don't change. Schema drift, late-arriving data, upstream teams breaking contracts without telling you. These are eternal. The engineers who build careers around solving those problems, not around knowing the tool that solves them this quarter, are the ones still standing in 5 years.

What's your burnout story? And more importantly: what are you doing about it?

Entry-Level Data Engineering Is Gone. Here's the Proof.

DataDriven — Thu, 30 Jul 2026 10:08:46 +0000

I've been on both sides of the data engineering hiring table for years. Interviewed candidates, been the candidate, watched the market shift underneath both. Here's something nobody in the industry is saying plainly: if you're trying to break into data engineering as a junior in 2026, the door you're walking toward doesn't exist anymore.

That's not pessimism. That's the data.

The 67% Junior Data Engineer Collapse

Junior data engineer postings have fallen 67% since generative AI went mainstream. Not a soft dip. Not a cyclical correction. A structural collapse. Only 3% of data engineering job postings in 2026 are explicitly entry level, requiring 2 years of experience or less. Out of 6,877 active postings analyzed in May 2026, that's 219 roles. For context, data analyst roles sit at 8% entry level. The gap is not subtle.

Stanford's Digital Economy Lab quantified the mechanism: junior developer employment (ages 22 to 25) dropped 16% since ChatGPT launched, while workers 30+ in high-AI-exposure fields saw 6 to 12% growth. Erik Brynjolfsson, the lab's director, put it plainly: "It was really striking to see such a sharp effect for certain categories and not others."

The reason is straightforward. AI commoditized the work that juniors used to cut their teeth on: staging SQL, scaffolded DAGs, schema mappings, boilerplate unit tests. The 70% of a junior pipeline engineer's first 2 years that was rote work? It's auto-generated now. dbt Copilot went GA in March 2025. Databricks Assistant handles schema detection and documentation. The bridge work disappeared, and nobody built a replacement bridge.

Writing boilerplate is how you learned what boilerplate does. Companies automated the learning pathway without creating a replacement curriculum.

54% of engineering leaders plan to hire fewer juniors in 2026, explicitly citing AI copilots as the reason senior engineers can cover more ground without backfill. New grad hires dropped to 7% of Big Tech hiring, down from roughly 30% in 2019. That's a 78% reduction. The CS Class of 2026 faces 6.1% unemployment despite net tech job growth; 70% report career pessimism. And 48% of visible data engineering roles are "ghost jobs," posted for org politics or internal pipeline building and never actually filled. The real entry-level number is likely worse than 3%.

Hiring Is Up 23% in 2026. Not for You.

Here's what makes this genuinely cruel: total data engineering hiring grew 23% year over year. 260,000 US openings projected. The global DE services market hit $105 billion in 2026, growing at 15% CAGR toward $213 billion by 2031. By every macro measure, data engineering is thriving.

Every single gain is concentrated in senior and specialized roles.

Mid-level DE II median compensation sits at $139K. Senior median: $174K base, with top quartile clearing $218K. The salary premium for experience is widening, not narrowing. Companies are paying more for fewer people who can do more; the arithmetic doesn't include juniors.

This isn't a downturn. It's a bifurcation. The field didn't shrink; it stratified. And a bifurcation is actually worse for career switchers than a uniform decline would be, because at least a uniform decline preserves the ladder. This market deleted the bottom rungs.

Meanwhile, 123,000+ tech jobs were eliminated in the first half of 2026. May alone hit 38,242 cuts, the highest single month since August 2024. 54% of layoff events explicitly cite AI as the cause. Oracle dropped 21,000 people, 13% of its global workforce, and spent $1.84 billion on severance. But here's the contrarian read: a lot of this is COVID overhiring correction dressed up in AI language. Block's headcount ballooned 160% between 2019 and 2024. That's not an AI story; that's a bubble story. Companies that hired too aggressively during zero-interest-rate mania are now calling it "AI transformation" on the way down.

The version of the job that involved connecting source A to warehouse B with tool C is disappearing. Architecture, governance, debugging judgment, cost optimization: that's the whole game now. Companies aren't hiring fewer data engineers. They're hiring fewer kinds of data engineers.

One exception worth noting: Databricks is sitting on 840+ open roles with 65% revenue growth and a $134 billion valuation. They're one of the few data infrastructure companies actively adding headcount. They even run explicit new-grad programs. But their new-grad APM roles pay $133K to $150K, exceeding typical entry-level DE salary by $30K or more. Even the outlier hiring juniors is funneling them into PM and sales tracks, not IC data engineering. Maybe the bottleneck isn't "companies won't hire juniors." Maybe junior DE roles are just harder to design than the industry realizes.

The Bootcamp Pipeline That Leads Nowhere

Bootcamps are still enrolling students for junior data engineer roles that the market has functionally stopped posting.

The marketing says 79% placement rates. The CIRR-audited data, the actual standard, says 50 to 70%. The gap isn't noise; it's a generation of bootcamp completers quietly underemployed or pivoting away entirely. Only 5% of working data scientists list a bootcamp as their highest credential. Average first salary for a bootcamp grad: $70,698. Time to first job has doubled from 4 months in 2022 to 6 to 12 months in 2026.

App Academy, Turing, Tech Elevator, Hack Reactor: all faced layoffs or closures. The pipeline that was supposed to feed the industry is contracting alongside the roles it trained people for.

I'm not dunking on bootcamp grads. If you went through one and came out writing Python and SQL, you learned real skills. 3 years of pipelines running in production is not a lie; you shipped real things. Stop discounting that. But the product those programs sold, the "12-week bootcamp to $100K+ junior DE role" pitch, that product no longer maps to a market. You got trained for a job that stopped existing while you were in the cohort.

What companies actually want now is end-to-end ownership. Distributed systems design, real-time pipeline development, cloud cost optimization, AI infrastructure integration, data governance. None of these are taught in most bootcamps. FinOps is mandatory, not nice-to-have. The top 5 in-demand DE skills for 2026 are all senior-level competencies. The World Economic Forum projects demand will exceed supply by 30 to 40% by 2027, but the shortage is for experienced engineers, not warm bodies who can write a SELECT statement.

The market is making explicit what was always true: data engineering is not entry level. It combines business context, analytics insight, infrastructure, software engineering, and SRE. It never should have been anyone's first job in tech, and the industry finally priced that in.

The One Realistic Data Engineering Career Path (For Now)

So what do you actually do if you're trying to break in?

Stop targeting job titles that have a 3% posting rate. The reliable path now, according to every recruiter and hiring trend analysis I can find, is analyst or backend engineer for 12 to 18 months, then internal transfer. Not bootcamp to junior DE directly. Analytics engineer roles sit at 8% entry level, nearly 3x the rate of DE roles, and they pay 15 to 30% less. That sounds like a downside until you realize it makes you a higher ROI hire for resource-constrained teams. dbt, SQL modeling, testing, observability: these skills transfer directly into data engineering once you have the production reps.

The deeper problem is that GenAI didn't kill junior hiring because juniors can't learn. It killed it because companies stopped needing people to write boilerplate. The constraint isn't learning capacity; it's production credibility. Juniors who can diagnose data failures in production or operate real-time infrastructure still get hired. Streaming roles have higher barriers but lower competition because fewer juniors target them. A junior who can run Kafka or Flink in a small project is rarer and more valuable than the 100th SQL/dbt resume on the pile.

Focus on what AI can't do. Data quality ownership is becoming a legitimate specialization, not a junior holding pen. The AI engineer demand gap sits at 3.2 to 1, with 1.6 million open positions against 518K qualified candidates. LLM specialists are commanding $220K to $280K. That's not a junior salary, but it's the direction the field is pulling toward.

And above all: study the concepts, not the tools. Data modeling, query optimization, understanding why things break. That's the study plan. Tools change every 18 months; the problems don't change. Schema drift, late-arriving data, upstream teams breaking contracts without telling you: these are eternal. Companies are hiring for judgment instead of syntax, which is exactly why we built datadriven.io data engineer interview practice around the concepts that transfer across any stack, because the syntax was always the easy part.

Here's the thing that should worry hiring managers, not just candidates. Companies cutting junior hiring now are creating tomorrow's mid-level talent shortage. The senior engineers they're paying $174K to $218K didn't materialize from thin air; they started as juniors somewhere. When the supply dries up, the bidding war gets uglier. Some firms already see this: IBM and Cognizant are tripling and quadrupling their entry-level pipelines in 2026 while everyone else contracts. They're betting that investing in training today beats fighting the talent war in 3 years. I think they're right.

The field isn't dying. It's a $105 billion market growing at 15% a year. But the on-ramp is different now, and nobody owes you the old one back.

What's your path in? Are you routing through analytics, backend, or something else entirely?

DSA Is Dead. What Replaced It Is Somehow Worse.

DataDriven — Tue, 28 Jul 2026 10:08:05 +0000

I spent 3 months in an interview cycle last year. 5 companies, 4 different interview formats, zero consistency. One company gave me a LeetCode medium and timed me for 25 minutes. The next handed me an ambiguous system design prompt with no rubric, no hints, and an interviewer who checked Slack twice during my answer. The third sent a 15-hour take-home that asked me to build a complete ELT pipeline, write tests, document it, and present it to a panel. I did all 3 in the same week.

DSA is dying in data engineering interviews. Everyone agrees on that. Algorithm rounds have collapsed to roughly 4% of real interview content for DEs, down from what felt like half the loop 3 years ago. The community spent years yelling about how inverting a binary tree has nothing to do with building pipelines. Companies listened. They dropped the algo rounds.

And then they replaced them with absolutely nothing coherent.

The Replacement Is 5 Different Experiments With No Control Group

Here's what the post-DSA hiring landscape actually looks like in 2026: big tech still runs 4 to 6 standardized rounds with system design at the center. Mid-market companies interview data engineers like software engineers (same loop, same questions, different title). Startups compress into 2 to 3 rounds optimized for day-one contribution. Enterprises vary so wildly that 2 teams within the same company can run completely different loops.

Between 2023 and 2026, the data engineering role expanded from "batch ETL plumber" to real-time architecture, cloud cost optimization, metadata governance, platform engineering, and AI integration. Fewer than 30% of companies updated their assessment systems to match. The role evolved; the interview didn't.

Take-homes have ballooned. About 25% of companies now include take-home assignments, and these aren't the 2-hour affairs they used to be. We're talking 10 to 20 hours: build an ETL pipeline, add tests, write documentation, present to a panel. That's not an interview; that's unpaid consulting. Engineers with market power skip them entirely; only candidates with no alternatives grind through. The side effect is ethically grim and everyone knows it.

Experienced engineers are failing screens designed for new grads. Take-home projects have ballooned into unpaid consulting gigs. The disconnect between what companies test for and what the job actually requires has never been wider.

The "11-minute cliff" from DataDriven's 75 dataset (6,538 data engineers, 412,887 graded queries) tells a brutal story: candidates who submit their first code attempt within 11 minutes pass 67% of the time. Those who take longer? 8%. The people who pause to think, who reason through edge cases the way you would in production, get punished. The interview rewards speed; the job rewards caution. These are opposite incentive structures, and seniors are the ones getting crushed by them. I've watched people with 10 years of experience get eliminated by screening rounds designed for someone with 2. Not because they lack skills, but because the format rewards interview-game fluency over engineering judgment.

Data Modeling: The Most Important Skill Nobody Tests For

Two-thirds of companies skip data modeling entirely in their interview loops. The single most job-critical skill in data engineering, the one that determines whether everything downstream works or silently breaks, and most companies don't even have a round for it.

They'll spend 45 minutes on a LeetCode medium and zero minutes on whether you understand grain, slowly changing dimensions, or why wide denormalized tables are eating star schema alive.

The DataDriven 75 dataset reveals something even stranger: senior data engineers (L5) pass data modeling on first attempt at 27%. Juniors (L3) pass at 34%. That's an inverse seniority effect on the most job-relevant skill. Seniors have been shipping production pipelines for years; they know this stuff cold. But they haven't been grinding prep problems, and the format rewards memorized terminology over deep reasoning. A junior who crammed "star schema" definitions 3 days ago outscores a staff engineer who's modeled 200 production tables.

The problem is structural. Data modeling doesn't have a LeetCode equivalent. There's no standardized problem bank, no automated grading, no YouTube channel with 500 solved problems. The prep industry built an entire economy around algorithms and left modeling in the dark. So companies avoid testing it because they can't grade it consistently. Most have no written rubric for schema reasoning. 5 interviewers evaluate the same answer; 5 different scores.

System design rubrics, by contrast, have evolved significantly. Judgment (32%) and depth (30%) now make up 62% of senior-level scores. Observability, SLA tradeoffs, operational maturity; these are mandatory scoring criteria, not bonus points. If you finish a 45-minute design without addressing how on-call engineers will debug it, you've left explicit rubric points on the table. But data modeling? Still the Wild West. The skill most predictive of whether your hire will ship grain misalignment to production on day one has no measurement framework at all.

The AI Policy Roulette Is Breaking Candidates

Last year I interviewed at 2 companies in the same week. Monday: "AI tools are strictly prohibited. Any evidence of LLM usage will result in disqualification." Thursday: "We expect you to use Copilot or Cursor during this round. We're evaluating how you collaborate with AI." Same week. Same candidate. Opposite rules.

62% of organizations still prohibit AI use in interviews. Over 50% of candidates use it anyway. Less than 30% have updated their assessments or retrained interviewers to account for the shift. The enforcement is pure theater: AI detection tools are useless. The same take-home submission scored 4%, 91%, 12%, 67%, and 38% AI-generated across 5 different detectors. Companies are running AI enforcement kabuki while the actual signal (can this person ship?) remains unmeasured.

5 companies now explicitly expect AI use: Canva, Rippling, Meta, Shopify, and Red Hat. Amazon full-disqualifies for unauthorized AI. Goldman Sachs bans ChatGPT entirely. Anthropic reversed its own AI interview policy mid-cycle in 2025 (banned in May, walked it back in July). Nearly 4 in 10 candidates now abandon hiring rounds that require AI interviews altogether.

Getting the rules wrong costs offers in both directions. Candidates who sneak AI into no-AI rounds get rejected for integrity. Those who refuse to touch AI in AI-allowed rounds look slow and out of date. Amazon, Microsoft, Meta, and Google all require engineers to use AI daily in production code, yet disqualify candidates for using the same tools in interviews. That's the hypocrisy nobody wants to say out loud.

71% of engineering leaders say AI makes assessing technical skills harder. Yet 76% simultaneously forecast increased productivity from AI-enabled assessments. Those 2 numbers can't both be right. You can't say "we have no idea what we're measuring" and "but we're confident it'll produce better outcomes" in the same breath. That's not a strategy; that's a PowerPoint slide dressed up as conviction.

Chinese tech companies are nearly 2x more likely than US firms to permit AI in live rounds. They've already exited take-homes. They observe how candidates think and collaborate with AI, not whether candidates can produce a clean solution from memory. 38% of US companies permit AI in interviews versus 68% in China. The US isn't losing on talent; it's losing on the willingness to commit to a direction.

The Burnout Cliff Behind the Hiring Wall

The broken interview pipeline isn't happening in a vacuum. 95% of data engineers report burnout. 70% are likely to leave their current employer within 12 months. 53% of enterprise engineering time goes to pipeline maintenance. And only 3% of data engineering postings are entry-level.

The career path has a hole in the middle. Juniors can't get in because entry-level jobs barely exist. Seniors can't stay because they're absorbing unsustainable scope. The field is growing 23% year over year with salaries clearing $125K to $200K+, and yet almost nobody is hiring juniors, seniors are fried, and the interview process that's supposed to restock the pipeline is filtering out the exact people it needs.

59% of SVPs and CTOs now believe weak engineers deliver net-zero or negative value in the AI era. That belief is driving hiring teams to experiment with AI-enabled rounds even though they have no measurement methodology. The result: more process, less signal, and a widening gap between "can pass an interview" and "can do the job."

What Actually Works

The answer isn't "bring back DSA." Algorithm questions were always a proxy, and a mediocre one, for data engineering skill. The answer is also not "replace DSA with nothing and pray that system design carries the load."

What works is testing what the job actually requires: data modeling with a real rubric, pipeline debugging where you hand someone a broken DAG and watch them trace it, cost reasoning where they calculate whether that Spark cluster is worth optimizing or whether the engineer's time costs more than the compute. And yes, coding. But coding that looks like production work, not competitive programming.

The concepts transfer; the tools don't. That's always been true. Data modeling, query optimization, understanding why things break: that's the interview that predicts job performance. Not whether someone can implement a trie under time pressure. If you're prepping right now, do 50 LeetCode mediums (you'll still see them at FAANG), but spend twice as much time on data modeling and pipeline architecture. Learn to talk about grain, cardinality, and SCD types the way you talk about hash maps and binary search. That's where the signal actually lives, and we built our practice sets for exactly that kind of work, so when someone says i use datadriven for pyspark interview questions they're getting reps on concepts that transfer to the actual job, not trivia that expires with the next Spark release.

The disease was real. DSA was a lousy way to evaluate data engineers. But the treatment is iatrogenic: 5 different experiments with no control group, no rubrics, and no consistency. We traded one broken system for 5 broken systems and called it progress.

What's the worst interview format you've encountered in 2026, and did it tell the company anything useful about whether you could actually do the job?

They Gave Me a 20-Hour Take-Home. I Did It. I Got Ghosted.

DataDriven — Thu, 23 Jul 2026 10:11:02 +0000

I spent a full weekend on a take home assignment for a Series B company. Built an end-to-end pipeline: ingestion, transformation, orchestration, tests, documentation. The instructions said "3 to 4 hours." It took 14. I submitted Sunday night. Monday, nothing. Tuesday, nothing. 2 weeks later, I followed up. Got ghosted. Never heard from them again.

That was 3 years ago. The problem has gotten dramatically worse.

53% of job seekers were ghosted by employers in 2026, up from 38% in 2024. 9% of those were ghosted specifically after completing a take home project or assessment. These aren't people who filled out an application and moved on. These are candidates who invested real hours, real thought, real labor into proving themselves, then received silence.

The data engineering interview loop has always been a gauntlet. DS&A, system design, SQL deep dives, behavioral rounds. But at least those happened in real time. You showed up, you performed, you got feedback (sometimes). The take home was supposed to be the humane alternative. Give candidates time. Let them work in their own environment. No whiteboard anxiety.

Instead, we got something worse.

The Whiteboard Died and Nothing Got Better

The anti-whiteboard backlash was legitimate. Solving a binary tree problem on a dry-erase board while 3 strangers stare at you is a terrible way to evaluate whether someone can debug a pipeline that silently drops 2M rows. Everyone agreed. The industry needed a better signal.

Take home projects were the answer. And for about 5 minutes, they made sense.

Then scope creep happened. A "2 to 3 hour" assignment became 8. Then 12. Then "build a full data pipeline with orchestration, testing, CI/CD, and a README that reads like production documentation." Companies started treating the take home not as a screen but as a proof-of-concept sprint. 45% of U.S. companies now use take home projects in their hiring process. 47% of hiring managers prefer them over live coding for mid-level roles.

The problem isn't the format. A well-scoped 90-minute take home with a code review follow-up produces some of the highest signal of any interview format. The problem is that "well-scoped" has become the exception. Time estimates are systematically dishonest: tasks marketed as "a few hours" routinely consume 12 to 20. One candidate documented canceling a weekend trip to finish an assignment, only to be ghosted for 5 weeks afterward.

And here's the kicker: 71% of engineering leaders now say AI has made technical assessment "meaningfully harder," with take homes suffering the worst signal degradation. 62% of candidates already use AI tools during interviews regardless of the rules. So the format that was supposed to replace the arbitrary whiteboard is now compromised by the same forces that made whiteboard performance meaningless.

The industry didn't solve the interview problem. It transferred the cost from companies to candidates, called it progress, and moved on.

Who Gets Filtered Out of Data Engineering Hiring

A 12-hour take home selects for people with 12 free hours. That's it. It doesn't select for the best data engineers. It selects against senior engineers with families, against people interviewing at multiple companies, against anyone who values their time proportional to their experience.

The numbers back this up. 40 to 60% of senior engineer candidates drop out of take home assessment processes. At Dropbox, before they pivoted away from the format, 20% of candidates simply never submitted. The primary withdrawal reason from senior candidates? "Too much unpaid time" and "another company finished my loop in 1 week."

This is the opposite of what hiring should do. You're not filtering for quality; you're filtering for availability. The engineer with 10 YOE, 2 kids, and a demanding job isn't going to spend her weekend building your toy ETL pipeline for free. She's going to take the offer from the company that respected her time with a 90-minute live session.

80% of surveyed engineers believe take homes should take 4 hours or less. 58% believe they deserve payment. Only 4% have ever received it.

Here's what makes it worse for data engineering specifically: the assignments aren't generic. A frontend take home might be "build a todo app." A data engineering take home is "ingest this CSV, model it into a star schema, orchestrate daily refreshes, handle late-arriving data, write tests, document assumptions." That's not a screen. That's a sprint.

The "unlimited time to show your best work" framing is a trap. High-conscientiousness candidates, the ones you actually want to hire, over-invest in polish, testing, and documentation. A "3-hour task" becomes a weekend because they can't submit something they'd be embarrassed by. The format punishes exactly the trait you're screening for.

Ghosted After 20 Hours: the Feedback Black Hole

94% of candidates want feedback after an interview. 5.5% receive it.

You can frame take home assignments as evaluation tools. You can frame them as equitable alternatives to whiteboard hazing. But when you hand someone a 20-hour project, they complete it, you reject them, and you give zero feedback, you've extracted labor for nothing. The candidate calls it getting ghosted. Some are starting to call it spec work.

The asymmetry is staggering. An employer can ask 10 candidates to do a take home project in a week: 70 hours of candidate labor total, 1 to 2 hours of employer review. And the worst part? 79% of candidates would reapply to a company that rejected them if they received constructive feedback. The feedback gap isn't just rude; it's bad strategy. Companies are burning their own candidate pipeline because writing "we went with someone whose modeling approach aligned more closely with our stack" takes 45 seconds and nobody will do it.

Interviews per hire jumped 42% since 2021, from 14 to 20 per position. Time to hire increased 24%. The process is getting longer, the feedback is getting sparser, and the labor ask is getting bigger. 72% of job seekers report negative mental health impacts from long hiring processes and poor employer communication. That's not a statistic; that's a gut punch.

And then there's the legal question that nobody wants to ask out loud. Under the Fair Labor Standards Act, anyone performing real work that benefits an employer must be paid at least minimum wage, even during a trial. The DOL successfully recovered $50K in back wages from a company that disguised unpaid candidate "working interviews" as applications. Most take home ghosting stems from hiring process chaos (role closure, budget freeze, manager turnover) rather than deliberate code theft. But the fact that the question even comes up tells you everything about how broken trust has become.

Without a signed agreement, you retain copyright on your take home submission. "Retain copyright" and "can prove a company shipped my transformation logic" are very different things, though. The spec work accusation may be overstated for most roles. But when a company asks you to build something on their proprietary dataset, using their business rules, solving a problem that looks suspiciously like a feature on their roadmap? That's not evaluation. That's consulting. And consulting gets invoiced.

What Good Actually Looks Like (and How to Protect Yourself)

Stripe's SQL Bug Squash interview is 45 to 60 minutes. The candidate debugs 4 to 5 broken production SQL queries live, collaboratively, with an interviewer. It isolates debugging skill, which is what data engineering actually is most of the time. It sidesteps the "was this AI-generated?" problem entirely because you're watching someone think in real time. And it takes an hour, not a weekend.

The ethical benchmark for take homes already exists: 3 to 4 hours of scoped work, delivered within a 48 to 72 hour window, with a committed feedback timeline. This isn't novel. It's the standard most companies acknowledge and then violate.

Live pair-programming with AI tools allowed is emerging as the strongest replacement: 60 to 90 minutes, interviewers observe real-time workflow and decision-making. You can't fake your way through a live debugging session with Copilot; the interviewer sees how you prompt, how you evaluate suggestions, how you reason under pressure. That's signal. A polished take home submission tells you someone (or something) can write clean code. It tells you nothing about how they work.

If you're preparing for these kinds of loops and want to sharpen the fundamentals that actually get tested, we built the prep around exactly this reality; check DataDriven for etl interview questions that mirror real debugging and modeling scenarios, not toy problems that waste your time twice.

But prep is only half the equation. You also need to protect yourself before you start.

Ask for the feedback commitment upfront. Before you accept the assignment, ask directly: "Will I receive written feedback regardless of the outcome?" If they hedge, that tells you everything. A company that won't commit to 5 minutes of feedback after asking for 10 hours of your time has already shown you how they value the exchange.

Sequence matters. Don't do the take home before initial interviews. Talk to the team first. Get a read on culture, on the role, on whether you'd even want to work there. If you invest 15 hours and then discover in the onsite that the "data engineering" role is actually an analyst position with a pipeline on the side, you've wasted a weekend.

Time-box ruthlessly. If they say 4 hours, spend 4 hours. Submit what you have. Add a README section called "What I'd do with more time." If they reject you for not gold-plating beyond their own stated scope, that's a company that will expect 60-hour weeks and call it "ownership."

Negotiate the format. About half of candidates dislike take homes enough to drop out. You can propose alternatives: a portfolio walkthrough of production work you've already built, a shorter time-boxed replacement, a live pairing session. Some companies treat refusal as disqualifying. Those are the same companies that will ghost you after you submit. You're not losing much.

The take home interview isn't inherently broken. A tight, well-scoped, 3-hour assignment with a feedback guarantee and a code review follow-up is genuinely good signal. But that's not what most companies are running. What most companies are running is a 20-hour unpaid work trial with no feedback, no respect for your time, and a 53% chance of total silence.

The format was supposed to be the humane alternative. Right now, it's just the whiteboard in a nicer suit.

What's the worst take home you've been asked to complete, and did you ever hear back?

Data Engineer Salary 2026: Every Survey Is Lying to You

DataDriven — Tue, 21 Jul 2026 17:33:23 +0000

I pulled salary data from 6 different sources last month. Got 6 different answers. The spread wasn't a rounding error; it was $55,000.

Career pages from real companies posting real roles showed a median data engineer salary of $185,000. Glassdoor said $134K. ZipRecruiter said $130K. If you're about to walk into a negotiation, which number you believe is the difference between a strong counter and a shrug.

I've been on both sides of the hiring table at companies whose names you'd recognize. I've watched candidates anchor to the Glassdoor number and leave $40K on the table. I've watched others walk in with career page data, cite it calmly, and get what they asked for, because the hiring manager already knew the budget was there.

Every major salary survey is structurally wrong. Not "slightly off." Wrong as in they're measuring a different population than the one that's actually getting hired.

The $55K Data Engineer Salary Gap Nobody Wants to Explain

An analysis of 244 real job postings pulled from company career pages in 2026 shows a median data engineer salary of $185,000. Remote roles median even higher at $187,000. San Francisco, weirdly, comes in at $179,000.

Now compare that to the survey platforms. ZipRecruiter: $129,716. Glassdoor: $133,861. Indeed: $136,776. Each one sits $50K+ below what companies are actually posting when they're trying to fill seats.

This is not a disagreement about methodology. It's a $55K chasm caused by fundamentally different measurements. Career pages capture what a company will pay right now to hire someone. Surveys capture what a mixed bag of respondents reported earning at some point in the recent past. These are different questions producing different answers, and most people don't realize they're looking at the wrong one.

The gap gets worse when you factor in that only 14% of tech job postings even disclose salary. When companies do post numbers, they tend to be the ones with competitive budgets. The thousands of postings with no salary listed? Those are the ones dragging survey medians down through omission.

And then there's FAANG, which breaks every survey completely. Meta data engineers: $322K median total comp. Google: $276K. Netflix: $565K in straight cash. An E5 at Meta (senior level) pulls $229K base + $222K annual stock vest + $27K bonus. That's $478K total. Netflix L5 clears $550K with no equity complexity at all. None of these numbers exist in Glassdoor. They're invisible to traditional survey methodology because the people earning them don't fill out surveys.

Why Every Data Engineering Salary Survey Gets It Wrong

Here's the dirty secret about salary surveys: they don't measure the market. They measure whoever decided to fill out a survey.

And who fills out salary surveys? Not the L5 at Netflix clearing $550K in cash. Those people have zero incentive to spend 15 minutes on a Glassdoor form. The people who fill out surveys are disproportionately earlier in their career, disproportionately frustrated with their pay (59% of tech workers report feeling underpaid), and disproportionately concentrated in a handful of metros.

This creates 4 compounding biases that make every number you see structurally wrong.

Self-selection bias. Crowdsourced salary data is driven by who shows up. Workers who feel underpaid submit to complain. Workers who feel overpaid submit to boast. The actual median; the people in the middle? They're doing their jobs. One audit found 43% of crowdsourced salary submissions were off by 15%+ from market benchmarks. That's not noise. That's a broken instrument.

Geographic skew. San Francisco Bay Area tech salaries run 126.6% of the national average. SFBA software engineers earn a median $233K while national surveys report $125K to $135K. Every survey oversamples coastal hubs because that's where the respondents are, which pulls the number in directions that don't represent the national market or the remote market where the money increasingly lives.

Title dilution. "Data engineer" in 2026 could be a warehouse analyst at $90K, an ML platform engineer at $200K+, or a senior data architect at $250K+. Surveys that report a single median for this title are averaging incomparable roles. It's like reporting the "average vehicle price" across sedans, dump trucks, and Ferraris.

The equity invisibility tax. Surveys almost never disaggregate base from total comp. A data engineer at FAANG might show $230K base, but the $170K in annual equity vesting and $25K bonus bring real compensation to $425K. Meanwhile, a survey respondent at a non-tech enterprise sees base ≈ total comp. Mashing these together into one "average" is statistical malpractice.

The survey is measuring what people accepted 2 years ago. The career page is measuring what companies will pay today. If you're negotiating tomorrow, only one of those numbers is useful.

Here's the thing about Glassdoor specifically: it wraps self-reported data in additional comp estimates, which inflates some figures while dragging others down. PayScale skews early-career because of who fills out their forms. ZipRecruiter reflects what's posted, not what's accepted. Each source surveys a different crowd and measures a different thing. Workers making $250K+ rarely respond to public salary surveys at all; privacy risk, employer visibility, lack of motivation. The top 15% of earners are systematically underrepresented, pulling reported medians down 10% to 15% compared to actual compensation.

There is no unbiased source. But some sources are less wrong than others.

The Entry-Level Collapse That Broke Every Average

Only 3% of data engineer postings in 2026 are entry-level. Down from 10% to 15% historically. Junior data engineering postings fell 67% post-GenAI, with entry-level hiring collapsing 73% year-over-year between late 2023 and late 2025.

66% of CEOs are actively freezing entry-level headcount. Not pausing. Freezing. They're trading junior hires for "judgment hires": mid and senior engineers who can architect systems, debug production failures, and make governance decisions that AI can't touch. AI automated the boilerplate: staging SQL, scaffolded DAGs, schema mappings. It did not automate architecture, governance, debugging judgment, or cost optimization.

The total data engineer market still grew 23% year-over-year in headcount. The global DE services market hit $105 billion growing at 15% CAGR. But all of that growth is seniority-weighted. Companies are hiring more data engineers; they're just not hiring juniors.

This does 2 things to salary data. First, it pulls every average up mechanically. When the bottom 10% to 15% of earners vanishes from the hiring pool, the median jumps without anyone getting a raise. The $185K career page median isn't inflated; it's accurate for the population that's actually getting hired. The survey-reported $130K is understated because it's sampling a truncated pool that includes people who accepted junior rates 3 years ago.

Second, it creates a bifurcated market that a single median can't capture. Junior data engineer ranges sit at $72K to $97K on ZipRecruiter. But Glassdoor reports $126K average for the same title; a 75% variance driven by geographic and sample bias. Base salaries fell 15% to 25% below 2022 peaks, but this hit juniors disproportionately. AI/ML specialists command 30% to 50% premiums over generalists. If you can run production Kafka pipelines, you're in a fundamentally different market than someone looking for their first role.

Companies are advertising junior roles, then quietly filling them with experienced engineers. This isn't a hiring freeze; it's a bait-and-switch.

The uncomfortable math: if companies stop hiring juniors today, they're engineering a senior shortage in 5 to 10 years. But CFOs don't optimize for 2031. They optimize for this quarter's headcount target.

What to Actually Bring to Your Next Interview and Negotiation

60% to 70% of candidates accept the first offer without countering. Those who negotiate with market data see 15% to 20% increases on average; about $24K median increase in tech.

The difference between a good salary negotiation and a bad one is which data you walk in with.

Career page postings for your target company and comparable companies. These reflect current budgets, not historical averages. If the posting shows $170K to $210K, your anchor is the 75th percentile, not the midpoint.

Levels.fyi for tech-specific roles, especially FAANG. The data disaggregates base, equity, and bonus, which matters when total comp runs 2x to 3x base. And here's what most people miss about equity: it's renewing, not depreciating. An L5 engineer's compensation contains overlapping tranches. Initial grant (years 1 to 4), year-2 refresher (years 2 to 5), year-3 refresher (years 3 to 6). This creates a $125K to $150K annual equity floor after the initial grant vests. Ask explicitly: "What's the typical annual refresher equity grant?" That's the question that separates people who understand comp from people who don't.

Robert Half and Motion Recruitment salary guides, which segment by level and geography. Robert Half reports $127K to $180K entry-level, $160K to $215K senior. Tighter ranges, more useful than a single median.

Glassdoor and ZipRecruiter as a floor, not a ceiling. If the survey says $130K, treat that as the minimum. Your job is to prove you're worth the career page number.

Skill premiums stack and they're documented. Kafka/streaming production experience: $15K to $50K over senior baseline. AWS Data Analytics Specialty certification: +$18K. Spark expertise: 15% to 25% premium. Both batch and streaming? 30% to 50% salary jump. Streaming carries the steepest premium because production Kafka is hard to learn without a production Kafka environment; the barrier to entry is structural, not educational.

Don't forget the base salary multiplier: your bonus is usually a percentage of base. The higher you negotiate base, the higher every downstream calculation. One negotiation compounds for years.

And here's the part nobody tells you: interview prep and negotiation prep are the same skill. The better you perform in the loop, the stronger your leverage on the offer. When I was grinding through 20+ loops in a single job search, the difference between the lowball offers and the strong ones tracked almost perfectly with how well I'd prepared for each company's process. That's the problem we set out to solve with DataDriven; when someone says i used DataDriven for data pipeline interview questions, those reps covered the patterns that actually show up in loops, not generic textbook exercises.

Colorado's pay transparency law alone pushed posted salaries up 3.6%. As more states mandate disclosure, the gap between survey data and reality will shrink. But right now, in mid-2026, the data engineering salary market has a $55K information asymmetry. The side you're on determines whether you negotiate from strength or from a number that was wrong before you opened your mouth.

The tools change. The surveys will keep being wrong in the same ways for the same reasons. Learn which numbers to trust, walk in with the right data, and stop letting a Glassdoor screenshot be the reason you leave 5 figures on the table.

What's the biggest gap you've seen between what a survey reported and what you actually got offered?

The AI Cheat Tool Your Interview Cannot See

DataDriven — Thu, 16 Jul 2026 10:12:37 +0000

I've been on hiring panels where we spent 45 minutes convinced a candidate was sharp. Articulate answers. Clean code. Solid reasoning. Then in the debrief, someone pulled up the recording and timed the responses. Every answer: 4 seconds. Easy question, hard question, curveball follow-up. 4 seconds flat. Humans don't think like that. Humans stumble on hard problems and breeze through easy ones. This person's cadence was perfectly uniform. I'd love to tell you I spotted it in real time. I didn't. Nobody on the panel did.

That was 8 months ago. The tools have gotten significantly better since.

The Overlay That Broke Data Engineering Hiring

There's a new category of AI cheating tools that most interviewers don't know exist. Cluely, Interview Coder, Final Round AI; these aren't browser tabs a candidate Alt-Tabs to when you're not looking. They're invisible GPU overlays that use DirectX (Windows) and Metal (macOS) hooks to render LLM-generated answers directly on the candidate's monitor, beneath the capture layer that Zoom, Teams, and Google Meet use for screen sharing.

In plain English: when you screen-share on Zoom, the application captures pixels from a specific layer of the OS graphics pipeline. These overlay tools render their content below that layer, in the GPU's local frame buffer. The interviewer sees a clean IDE. The candidate sees the IDE plus a floating panel with AI-generated code and explanations. Those pixels literally don't exist in the video stream that gets encoded and transmitted.

This isn't a proof of concept from a security researcher. Cluely pulled 70,000 signups in its first week. It's a consumer product with standard SaaS pricing: free tier at 5 responses per day, $20/month for Pro, $75/month for the "undetectability" tier that does the GPU-level rendering. Cheating on your data engineering interview now costs less than a monthly gym membership.

The overlays don't trigger tab-switch alerts. They don't appear in keystroke logs. They don't show up in screen recordings. The proctoring vendors claiming 85-95% detection effectiveness? They're scanning for browser tab switches and copy-paste events. They're watching the wrong layer entirely. 6 new overlay tools emerged in 2025 alone, plus at least 3 open-source clones.

Screen-share monitoring is security theater. The pixels the interviewer sees are not the pixels the candidate sees.

Half Your Tech Candidates Are Cheating. Most of Them Pass.

Fabric analyzed 19,368 interviews between July 2025 and January 2026 across 50+ companies. The numbers are bleak.

38.5% of all candidates triggered cheating flags. For technical roles, that number hit 48%. Sales roles? 12%. The roles where the stakes are highest and the questions are most googlable are the roles getting gamed hardest. This inverts the assumption that technical interviews are somehow more honest by nature. They're not. They're just more automatable.

The acceleration is what gets me. Cheating went from 9% in July 2025 to 45% by September. 3x in 3 months. Then it plateaued through January; not because people stopped, but because it saturated. When nearly half your candidate pool is using AI assistance, you don't have a cheating problem. You have a broken measurement system.

The part that should make every hiring manager stop and think: 61% of flagged cheaters scored above the passing threshold and advanced in the pipeline. These aren't marginal candidates scraping by. They're clearing the bar comfortably, because the AI is genuinely good at answering the questions we ask. 61% is not a detection gap. It's an action gap. Companies flag candidates and hire them anyway because the score looked fine.

Junior candidates (0 to 5 years of experience) cheat at nearly double the rate of seniors. The people with the least context to evaluate whether an AI-generated answer is even correct are the ones relying on it most. It's a desperation play: they know AI fills knowledge gaps faster than grinding prep, and they're probably right. The incentive structure is broken.

Banning AI Doesn't Fix the Architecture

64% of companies ban AI in interviews. 80% of candidates use it anyway on take-homes. That's not a policy failure; that's a policy being laughed at.

The detection layer makes it worse. AI detection tools produce essentially random results: the same essay scored 4%, 91%, 12%, 67%, and 38% across 5 different detectors. OpenAI killed its own classifier in July 2023 because it was only 26% accurate. Stanford found a 61.2% false-positive rate on essays from non-native English speakers versus 5.1% for native speakers. You're not catching cheaters. You're penalizing people who learned English as a second language.

The industry response has been a stampede back to in-person interviews. They jumped from 5% to 30% in a single year. Google and McKinsey mandated in-person rounds in mid-2025, explicitly citing AI fraud. 72% of recruiting leaders say fraud prevention is the driver.

The problem: in-person doesn't scale. It's expensive, exclusionary, and locks out remote candidates, international candidates, and anyone who can't fly to your office for a day. The least scalable option is the one everyone's reaching for. That's not a fix; it's a retreat to 2019.

Take-homes are dead in their current form. Anthropic's own engineering team found that Claude Opus "matched top candidates" on take-home assessments and there was "no longer a way to distinguish between the output of top candidates and the most capable model." When the company building the AI tells you their model passes your take-home, believe them.

Eye tracking? Gaze monitoring? Also crumbling. NVIDIA Maxine synthesizes natural gaze. Candidates keep their eyes near the camera while reading overlays at the screen periphery. HireVue discontinued facial analysis in 2021 after finding facial expression data contributed less than 0.25% to performance predictions. The biosurveillance approach is simultaneously invasive and useless.

You can ban AI in interviews. You can't ban the architecture it runs on. The enforcement tools are more invasive than the cheating, and they still don't work.

The Interview That Survives

The strongest signal isn't software. It's one follow-up question.

AI generates polished, multi-layered code. But when you ask a candidate to explain line 7, or walk through why they chose that join strategy, or refactor their solution with a new constraint, the gap between "read this off a screen" and "actually understand it" becomes obvious in seconds. If you can't explain line 7, you didn't write line 7.

Consistent response timing is the second strongest behavioral fingerprint. Humans pause longer on hard questions. They stammer, correct themselves, say "let me think" with variable duration. AI overlay tools show uniform 3 to 5 second latency regardless of difficulty, because the pipeline is always: audio capture, transcription, LLM inference, render. That flatness is detectable. But only about 30% of interviewers actively monitor response timing. The other 70% miss it entirely.

System design remains the most AI-resistant format because it's fundamentally discursive. You can't read a system design answer off an overlay, because system design isn't a question with a fixed answer. It's a conversation that shifts when the interviewer changes constraints, pushes back on choices, and asks "what happens when this fails?" No overlay tool fakes that in real time. Not yet.

For data engineering interviews specifically, the path forward is clearer than for most roles. Pipeline architecture, data modeling exercises, debugging scenarios. "Here's a pipeline that silently dropped 2M rows last Tuesday. Walk me through how you'd find the problem." That question has no clean overlay answer because the solution depends on follow-ups about the specific system, the specific data, the specific failure mode. The actual job is debugging, not building; might as well test for it.

This is also why concepts matter more than tools, and always have. If your interview tests whether someone can write a Spark transformation, an overlay solves it in 4 seconds. If it tests whether someone understands why a pipeline breaks when upstream schema changes violate a downstream join contract, you're testing something AI can't fake. Concepts transfer across tools; syntax doesn't, and that gap is exactly why we built databricks interview prep with datadriven around architecture walkthroughs and data modeling, not the kind of timed problems an overlay solves in 4 seconds.

The career implications cut both directions. If you're a candidate who genuinely knows your stuff, push for system design and pair-programming rounds. Those formats favor you. If a company's entire loop is timed LeetCode and async take-homes, their signal is already compromised, and your real expertise is competing against someone paying $75/month for invisible help.

The companies that adapt their process will hire better. The ones clinging to LeetCode mediums and take-homes will keep onboarding engineers who can't debug a broken DAG in their first week, then blame the candidate instead of the process.

What's the most egregious cheating you've seen in an interview, on either side of the table?

Half of Data Engineering Jobs on LinkedIn Aren't Real

DataDriven — Tue, 14 Jul 2026 10:06:48 +0000

I applied to 47 data engineering jobs in a three-week stretch last year. Heard back from nine. Got interviews at four. Two of those companies had already filled the role before my first call. One admitted the headcount was "paused indefinitely." The fourth gave me a verbal offer that evaporated when the hiring manager left. That's the job market in 2026. You're not failing; you're playing a rigged game.

Here's the part that should make you angry: companies are publicly claiming data engineering hiring is up 23% year-over-year. That number is real. It's also one of the most misleading statistics in tech right now.

The Paradox: Hiring Is Up, But the Ladder Is Gone

Data engineering hiring grew 23% YoY. Entry level data engineering roles fell 67% since AI went mainstream. Both of these things are true at the same time.

The growth is exclusively senior hires. Companies aren't expanding their data teams; they're replacing junior pipelines with senior architects who can ship AI-ready infrastructure on day one. Only 2.3% of DE job postings target entry-level candidates with under two years of experience. The most common requirement? Four to six years, appearing in 11% of postings.

This isn't a downturn. It's a reclassification. What used to be "entry-level" got relabeled as "mid-level with 4+ years." The ladder didn't break; it got pulled up.

Junior developer postings across all of tech collapsed 60% between 2022 and 2024. Data engineering followed the same trajectory, just quieter. And here's the twist nobody talks about: job postings labeled "entry-level software engineer" grew 47% between October 2023 and November 2024, but actual hiring into those levels dropped 73% in the same window. Companies are advertising junior roles and filling them with experienced engineers. The title is a lie.

The market didn't grow 23%. It compressed vertically. The number went up; the ladder got removed.

Meanwhile, 66% of CEOs surveyed are freezing or cutting hiring through the rest of 2026 while simultaneously betting billions on AI infrastructure. LLM engineering skills in DE job postings spiked 300% in a single quarter, from 3% to 12%. The role is being rewritten in real time, and the rewrite doesn't include a chapter for people just starting out.

Half the Job Market Is a Mirage

Let me say this plainly: ghost jobs now account for 48% of tech job postings. Nearly half the roles you see on LinkedIn aren't real. They're not stale listings that HR forgot to take down (though some are). They're deliberate.

40% of tech companies posted fake jobs in the past year, and 79% of those listings were still active at the time of the survey. This isn't accidental. It's infrastructure.

Here's why companies do it. 62% of hiring managers admitted they post ghost jobs to make current employees feel replaceable. 43% cited signaling company growth to investors and board members. Nearly 60% collected resumes with no intention to hire immediately; they call it "talent pool management." The idea originates from HR (37%), senior management (29%), or executives (25%). Hiring managers, the people who actually need to fill roles, typically don't originate it.

93% of HR professionals engage in posting ghost jobs: 45% regularly, 48% occasionally. And 96% of recruiters use automated software to repost listings on a schedule, so jobs disappear and reappear with identical descriptions, the clock resetting every 30 to 90 days. The ATS never stops accepting applications even after the requisition is dead. If you got an automated rejection two to four hours after applying, that's not a keyword mismatch; that's a closed role running on autopilot.

The financial damage is real. 72% of job seekers report mental health damage from the application process. 37% suffer direct financial losses averaging $500 to $2,500. And the 47% of tech professionals actively job-hunting in 2026 (up from 29% last year) means there's an endless supply of desperate applicants feeding the ghost job ecosystem. Companies have no incentive to stop.

The worst offenders aren't FAANG and they aren't tiny startups. Companies with 1,001 to 5,000 employees post ghost jobs at nearly a 25% rate, the highest of any company size. That's the Series C through E band where CFOs tighten headcount while board pressure demands growth signals. If you're an early-career engineer, that's the exact cohort you're probably targeting. You picked the most deceptive segment of the market.

What the Real Postings Actually Want

So what do the legitimate data engineering roles look like in 2026? Different. Fundamentally different from two years ago.

Python (70%) and SQL (69%) are still non-negotiable. That hasn't changed. Everything else has. Machine learning appears in 29.9% of postings. Kafka shows up in 24%. CI/CD in one out of six. Apache Spark still dominates at 38.7%, but Snowflake (29.2%) and Databricks (16.8%) are carving out separate tiers. Companies don't want generalists who can learn their stack; they want people already fluent in it.

The role has absorbed platform engineering, DevOps integration, ML pipeline support, and governance orchestration into a single position. Data engineers must prepare data for AI use cases, collaborate with ML engineers, and understand feature stores, experimentation, and model serving. That sentence would have been nonsensical in a DE job description 18 months ago. Now it's baseline.

26% of job postings don't mention education requirements at all. That sounds like a window for self-taught engineers, and it is, but it's being filled by mid-career pivots with adjacent experience, not by people fresh out of bootcamp. The real barrier isn't credentials; it's that bootcamp curricula teach isolated SQL and Python while jobs demand LLM-aware pipelines, regulatory audit trails, and 99.95% uptime infrastructure. The skill tree forked, and the entry-level branch got pruned.

The median salary sits at $131K to $135K, which sounds great until you realize it's skewed by the shift toward senior talent. Senior contract data engineers command $150 to $185 an hour. Specialized AI-infrastructure architects bill $220 to $400. The floor rose because the people standing on it changed.

Where the Actual Jobs Are (and How to Stop Wasting Time)

Real jobs exist. They're just not where most people are looking.

Contract and platform migration work is where the volume is. Over 3,300 data migration jobs and 6,600+ technical data migration roles are active right now, mostly 60 to 90 day engagements for companies rebuilding data stacks for cloud migration and AI readiness. Snowflake and dbt expertise commands premium contract rates. These aren't glamorous FTE positions with equity; they're sprint work. But they're real, they pay, and they build the exact résumé signals that get you into full-time senior roles later.

Databricks alone has 840+ open roles. But here's the catch: that's the vendor hiring, not the customers. If customers were expanding data teams, they'd be hiring people to use Databricks. Instead, Databricks is hiring its own engineers to do POC work for under-resourced customers. Tool adoption isn't translating to team growth at the companies actually using the tools.

To spot a real posting versus a ghost, here's what I actually look at:

Check the company's own careers page. Two minutes on their site is still the best ghost job filter available. If the role isn't listed there, it's phantom. LinkedIn aggregates are noise.

Look at the posting age. Tech roles typically fill in 30 to 45 days. If a listing has been open for 90+ days, something is wrong. Jobs posted 30+ days show a 30% chance of never resulting in a hire.

Salary range omission is a red flag. 16+ states and D.C. now mandate pay disclosure. Listings that dodge it in those jurisdictions are either non-compliant or not real. 44% of candidates won't apply without a range; legitimate employers know this.

Watch for reposting patterns. Same title, same description, fresh date. That's the ATS auto-renewing a dead requisition. The clock reset doesn't mean new hiring intent.

Named hiring manager > generic HR. If the posting names a specific manager or team lead, someone is actually waiting for a hire. Generic "talent team" postings with no team context are pipeline collection.

The honest advice for early-career engineers: stop applying to 50 listings a week and start being surgical. Target companies under 1,000 or over 10,000 employees (lower ghost rates). Prioritize contract work that builds architectural experience. Get reps on the stuff that actually separates candidates in interviews: data modeling, pipeline architecture, system design thinking. That's exactly why we built datadriven.io; DataDriven is good for data engineer interview questions that test the concepts behind the tools, not trivia about Spark APIs nobody remembers anyway.

The entry-level data engineering path isn't dead. It's been rerouted. The reliable path now is analyst or backend engineer first, then internal transfer. That sounds frustrating, and it is. But it's also how most of us got here. I didn't start in data engineering. I started outside of tech entirely. The path was never a straight line; we just pretended it was for a few years when hiring was hot.

Data engineering is not shrinking. It's consolidating into a senior-heavy discipline that demands architectural thinking, governance awareness, and AI-infrastructure fluency. The tools change every 18 months. The problems don't change. Schema drift, late-arriving data, upstream teams breaking contracts without telling you. These are eternal.

The ghost job epidemic will burn itself out eventually; it's expensive for companies too, even if they don't realize it yet. But the reclassification of entry-level to mid-level? That's structural. That's not going back.

If you're grinding applications right now into what feels like a void: it's not you. Statistically, half of what you're applying to doesn't exist. That's not a personal failure. That's a broken system.

What's the most obviously fake job posting you've come across, and how far into the process did you get before you realized it wasn't real?

3 Staff Engineers Couldn't Pass This Single DE Job Posting

DataDriven — Thu, 09 Jul 2026 10:08:18 +0000

I sat down with two other staff-level data engineers last month. Between us: 40+ years in data engineering, multiple FAANG stints, and enough interview loops to fill a spreadsheet nobody asked for. We pulled up a single job posting from a Series C company with a real data team. Nothing exotic. Reasonable product, decent engineering culture, the kind of place you'd actually consider working.

Not one of us met every requirement on the job description.

The posting wanted SQL, Python, Airflow, Snowflake, Kafka, Flink, dbt, Terraform, Kubernetes, and "LLM integration experience." Fifteen distinct technologies across four engineering disciplines. Salary: $140K to $170K. That's the same range these roles paid in 2022, when the ask was SQL, Python, Airflow, and a warehouse.

Three staff engineers. 40+ combined years. Zero out of three qualified on paper.

If that doesn't tell you the hiring process is broken, I don't know what does.

The Impossible JD Is the New Normal

In 2022, a typical data engineering posting listed four or five core tools. SQL. Python. An orchestrator (usually Airflow). A warehouse (usually Snowflake or BigQuery). Maybe Spark if the company was processing serious volume.

In 2026, that same posting, at the same salary, now includes all of the above plus Kafka, Flink, dbt, Terraform, Kubernetes, and "LLM integration." LLM skills in data engineering postings jumped from 3% to 12% in a single quarter. That's not gradual adoption; that's panic hiring.

Here's the thing: these aren't complementary skills. They're separate career tracks wearing a trench coat. A Databricks engineer working on distributed compute and Delta Lake optimization is not the same person as a Snowflake engineer designing warehouse concurrency patterns. SQL mastery and PySpark proficiency are taught in different phases of a career for a reason. Databricks engineers earn a $10K to $15K premium over Snowflake engineers at equivalent levels, not because Databricks is "better," but because production Spark plus distributed systems expertise is scarcer than SQL-first warehouse knowledge. These are fundamentally different learning curves, different architectures, different day-to-day work. Yet job descriptions list both as "required" like they're interchangeable checkboxes.

Python appears in 70% of data engineer postings. SQL in 69%. But after that, the stack fragments: Spark at 38.7%, Snowflake at 29.2%, Kafka at 24%, Databricks at 16.8%. No two companies agree on what the stack actually is. So they list everything, hoping the perfect unicorn applies.

The unicorn doesn't exist. And the engineers closest to it; the staff-level folks who understand exactly how complex this landscape is; they read that JD and close the tab.

When experienced engineers see 14+ tools in one posting, many read it as "this company doesn't know what it needs," not "we're thorough."

Postings with 6 to 13 requirements receive about 30% more applicants than postings with 14+. That's not because the market lacks talent. It's because the people with the most experience and context are the ones most likely to self-select out. They know nobody does all of that. Junior candidates who don't know what they don't know are the ones clicking Apply.

Why Companies Keep Writing Fiction

This isn't malice. It's organizational dysfunction.

Most job descriptions aren't written by the person you'd actually report to. They're built by committee. The hiring manager adds SQL and Python. The VP adds Kubernetes and Terraform because "we're moving to cloud-native." The ML team bolts on LLM integration because they heard about it at a conference. The recruiter copy-pastes from a competitor's posting and sprinkles in whatever worked last time.

The result: three different jobs inside one posting. Platform engineering. Streaming infrastructure. Analytics engineering. ML operations. Each one a distinct specialization with a different learning curve and a different interview loop. Nobody on the hiring committee realizes they've described four humans, not one. And nobody pushes back because adding requirements feels free.

It's not free. Poorly written JDs are cited as the primary cause in over 50% of hiring failures. 44% of hiring managers can't fill their open roles, and the number is climbing. But here's the kicker: 94% of employers say skills-based hiring is more predictive of on-the-job success than resume screening, yet over half still screen against rigid checklists. They know the process is broken. They keep doing it anyway.

The compensation tells the rest of the story. Data engineering salaries rose from about $113K to $153K over the past few years. That's a 35% bump. The role scope roughly doubled. You're being asked to learn twice as much, own twice as much, debug twice as much; for a 35% raise. The economics don't work, and experienced engineers can see that from the posting alone.

And let's talk about the 40% of tech companies that posted ghost jobs in the past year. Nearly half of visible data engineering roles on LinkedIn aren't actual open positions. You're grinding through a 15-tool requirement list for a role that may not even exist. 62% of hiring managers admit their AI screening tools reject qualified candidates who don't match algorithmic patterns. So even if you apply, the ATS might bury you before a human reads your name. The filter is broken at every level.

What the Job Actually Requires on Day One

Here's what happens your first week at any of these companies. Nobody asks you to configure a Flink cluster, deploy a model to Kubernetes, and integrate an LLM into the data pipeline before lunch. What actually happens: someone points you at a broken pipeline, and you figure out why it's broken.

SQL and Python still carry the game. SQL appears in 94% of interview loops for data engineering roles, and SQL plus Python together get candidates through roughly 60% of real interviews. The other eight tools on the posting? Most teams deploy three, maybe four, in production. The rest is aspirational.

The actual job is less "architect a real-time streaming platform" and more "figure out why this pipeline silently dropped 2M rows last Tuesday and make sure it never happens again." Production work (debugging, incident response, observability) comprises around 60% of what data engineers do day to day. It appears in approximately 0% of job descriptions. Nobody interviews for that skill. They interview for Spark API trivia and LeetCode mediums. These are measuring different things entirely.

77% of data engineers report heavier workloads in 2026 despite AI tools that were supposed to lighten the load. Engineers now spend 37% of their time on AI-related projects, up from 19% two years ago. AI didn't replace work; it created new categories of work on top of the existing ones. The tooling promise of "do more with less" turned into "do more with more, and also learn this new thing by Friday."

So what actually matters? Data modeling. Query optimization. Understanding why things break, not just how to set things up when they're working. Pipeline architecture, not system design (data engineers don't care about load balancers and reverse proxies). The concepts that transfer across every tool, every warehouse, every orchestrator. Concepts transfer; tool knowledge doesn't. That has always been the thesis, and bloated job descriptions haven't changed it one bit.

The 70% Rule and How to Play the Game

Here's the practical advice. Apply at 70%. Not 70% of every random tool listed; 70% of the must-haves. SQL, Python, one orchestrator, one warehouse. If you've got those plus a track record of shipping and debugging production pipelines, you're in the conversation.

42% of applicants don't meet posted requirements. Companies fill those roles anyway. Hiring managers often know they won't get someone who ticks every box; the posting is a negotiation anchor, not a contract. 81% of U.S. employers have adopted skills-based hiring, up from 57% in 2022. The JD says 15 tools; the interview tests three.

Stop trying to learn Kafka and Flink and Terraform and Kubernetes simultaneously. That's tool chasing, and it's a trap. Double down on SQL, Python, and data modeling. Get your reps in on the stuff that actually gets asked. If you're sharpening the Python side, we put together python interview questions on datadriven specifically around patterns that show up in real loops, not obscure trivia nobody's ever tested on in an actual interview.

Optimize your resume for the three or four tools the team actually uses, not the 15 they listed. Don't match fiction with fiction. If a job description has more than six or seven distinct tools in the requirements, odds are it was committee-built and nobody on the actual team uses all of them. That's not a signal to disqualify yourself; it's a signal that the company will hire for the core and train for the periphery.

Strip back the scope anxiety. Senior and staff titles are converging on the same JD with $10K salary deltas. On paper, there's nowhere to grow. But in practice, the engineer who can debug a production incident, model a clean schema, and explain their design decisions under pressure is the one who gets hired and promoted. That hasn't changed in 15 years of data engineering, and it won't change because someone added "LLM integration" to a posting.

Three staff engineers, 40+ combined years, and none of us passed a single job description. That should liberate you, not discourage you. The posting is fiction. Your skills are real. Know the difference, apply anyway, and let the interview sort it out.

What's the most absurd set of requirements you've seen crammed into a single data engineering posting?

AI Is Cutting DE Jobs. It's Also Creating Them. Here's the Map.

DataDriven — Tue, 07 Jul 2026 10:07:35 +0000

I watched a friend get laid off from Meta's analytics org on a Tuesday. By Thursday, Meta had posted six new roles in their "Applied AI Engineering" unit that required almost identical pipeline experience. Different title. Different budget line. Same category of work, but pointed at LLMs instead of dashboards.

That's the game right now. And most people don't have the map.

52,050 Cuts. 23% Hiring Growth. Both Are True.

Q1 2026 produced 52,050 tech job cuts, the highest Q1 total since 2023; a 40% jump over Q1 2025. Of those layoff events, 56% explicitly cited AI as the reason. Meta cut 8,000 people. Intuit eliminated 3,000 (17% of their workforce). PayPal axed 4,760 (20%). Salesforce trimmed under 1,000 from data analytics and product management.

And yet: data engineering hiring is up 23% year-over-year, with roughly 260,000 open US positions projected for 2026. The data engineering market hit $105 billion this year and is projected to reach $213 billion by 2031.

These aren't contradictory numbers. They're describing two different jobs that happen to share a title.

The version of data engineering that was "connect source A to warehouse B using tool C" is getting automated. The version that involves distributed systems, governance, cost optimization, and AI infrastructure is in acute shortage. If you're a mid-level engineer watching both headlines and feeling whiplash, it's because you're standing on the fault line between a role that's dying and one that's exploding. The World Economic Forum forecasts 100% growth in big data specialist demand through 2030. Meanwhile, 63% of employers say they can't find qualified candidates. If supply were truly saturated from all these layoffs, hiring timelines would compress. They haven't. Time-to-hire for data engineers is stuck at 60 to 90 days in enterprise settings.

The paradox resolves when you stop thinking of "data engineer" as one job.

The Cut-and-Redirect Pattern

Here's what Meta actually did: cut 8,000 employees, then simultaneously moved 7,000 workers into AI-focused units called "Applied AI Engineering" and "Agent Transformation Accelerator." That's not a net reduction; it's a budget reallocation with human casualties.

Atlassian did the same thing at smaller scale: 1,600 jobs eliminated, 800 AI roles posted within weeks. PayPal cut 20% of its workforce while immediately posting for AI infrastructure and ML pipeline engineers. The pattern is so consistent it deserves its own name.

Companies aren't reducing data headcount. They're killing one version of the role and resurrecting another, and the six-month gap between the cut and the rehire is where careers go to die.

Here's the number that should make you uncomfortable: 52.1% of companies making AI-driven layoffs rehired for nearly identical roles within six months. Not identical titles, but identical skill categories. The press release says "AI eliminated these positions." The LinkedIn posting six months later says "seeking experienced data engineers for AI platform." Same budget. Same org chart slot. Different words.

And 55% of business leaders who pulled the trigger on AI-driven cuts now regret the decision, after discovering that AI handles 94% of routine tasks but falls apart on judgment calls. IBM and Ford have been quietly rehiring. Nobody writes a press release about that part.

Anthropic, OpenAI, Cohere, and Mistral hired 6,200 people combined in H1 2026. Record pace. The talent has somewhere to go; the problem is that most displaced engineers don't have the specific skills those roles demand. Roughly 40% of displaced workers land in mid-market companies, 25% become contractors, and only about 15% actually change specialties. The pipeline from "laid off ETL engineer" to "hired AI infrastructure engineer" has a massive leak in the middle.

What AI Actually Made Cheap

Let's be specific about what got commoditized, because vague panic helps nobody.

Basic SQL generation. Text-to-SQL tools now hit about 78% execution accuracy on zero-shot queries. That sounds impressive until you realize one in five queries is silently wrong: hallucinated columns, faulty joins, dropped WHERE clauses, missing tenant scoping. The query runs. It returns results. The results are wrong. Nobody notices for weeks. I've seen this movie before; it used to star junior analysts instead of LLMs. The failure mode is identical; the scale is larger.

Boilerplate ETL scripting. Source-to-target mapping, schema detection, field mapping. Databricks reported that 80% of new databases on their platform are now created by AI agents, up from 30% a year ago. The plumbing got automated. If your entire job was plumbing, you should be worried.

AutoML patterns. Hyperparameter search, basic feature engineering, architecture exploration. Cycles that took weeks now take hours. But AutoML doesn't recognize when the problem framing itself is wrong. It optimizes within the frame you give it; it can't tell you the frame is garbage.

Dashboard maintenance and ad-hoc reporting. Data analyst job openings fell roughly 40% from peak. The "pull this data for me" function is collapsing into self-service AI tooling. Microsoft Copilot, Tableau AI, and their cousins are eating this alive.

Here's what didn't get commoditized: schema evolution decisions. Data contracts. Lineage governance. Cost optimization at scale. Figuring out why your pipeline silently dropped 2M rows last Tuesday and making sure it never happens again. The judgment layer is intact. The mechanical layer is not.

This is why the old advice still holds: concepts transfer across tools; tool knowledge doesn't transfer across concepts. The engineers who spent their career learning "how Airflow works" are in trouble. The ones who spent it learning "how to design systems that don't fail silently" are getting promoted.

The Map: What's Actually Getting Hired

If you're navigating this transition, you need specifics, not vibes. Here's where the hiring is happening, and what it pays.

MLOps and AI infrastructure. Salaries range $130K to $257K, with LLM deployment experience consistently pushing past $200K. AI infrastructure engineer salaries jumped 15 to 30% in H1 2026, averaging $320,000 in San Francisco. This is the hottest category by far, and it's not close.

Streaming and real-time systems. $114K to $137K average. I still think streaming is overrated for most companies (most of y'all don't need it), but the ones that need it are paying well and hiring fast. Confluent cut 800 employees; Databricks had 840 open requisitions the same month and actively recruited from that pool. That's not market equilibrium; that's targeted talent consolidation.

Data governance. Over 6,500 open governance roles in the US, averaging $113K annually. GDPR pressure, AI governance requirements, and the realization that you can't ship AI products on dirty data are driving this. Not the sexiest work. Pays reliably.

FinOps and cloud cost optimization. $98K to $167K for cloud FinOps roles. Every company that went all-in on cloud compute is now discovering the bill. They need people who understand both the data and the economics. If you consider the cost of running unoptimized pipelines versus the cost of the engineer's time optimizing them, the economics clearly favor hiring the engineer.

What's conspicuously absent from the hiring surge: junior-to-mid-level generalist data engineers. The 23% growth is concentrated at the senior-specialist tier. Engineers under 30 saw the greatest decline. Job descriptions are collapsing three roles into one: platform engineering, ML pipeline support, and governance orchestration. That's scope creep masquerading as demand.

The Comp Bifurcation

Now here's the part nobody talks about honestly. The AI salary premium over traditional DE roles widened from 25% in 2024 to 56% in 2026. A traditional ETL developer averages $145K. An AI/ML engineer averages $173K to $193K base. LLM specialists command $220K to $280K. Frontier lab researchers clear $600K.

FAANG senior data engineer total comp sits at $250K to $350K, with stock composing more than half the package. Non-FAANG senior comp: $105K to $175K. Stripe pays about $210K for senior DE, which sounds great until you realize it's still 33% below Google's floor. Even at the 95th percentile of non-FAANG, you're hitting the 25th percentile at Google.

The real dividing line isn't FAANG versus startups. It's equity-heavy jobs versus equityless jobs. A data engineer at Meta L5 makes roughly $350K all-in with about $250K from RSUs vesting linearly. A data engineer at a healthcare company makes $140K all-cash with no equity. One of these paths builds generational wealth. The other one consumes it.

A $150K ETL architect doesn't become a $320K AI infrastructure engineer without 12 to 18 months of intentional retraining. The skills are orthogonal, not adjacent. That's the structural trap nobody in HR wants to acknowledge.

So what do you actually do about it? Stop treating this like a tool problem. Data modeling, distributed systems thinking, cost optimization, governance: these are the concepts that transfer. The specific AI tools will change in 18 months. They always do. I've been through three waves of "data engineering is getting automated away." Still here. Still employed. Still debugging the same categories of problems, just with fancier abstractions on top.

Interviewing is a separate skill from the actual job, and the bar has shifted. If you want to pressure-test where you stand, that's exactly why we built out our datadriven.io data engineer interview questions around architectural thinking and system design rather than tool trivia; the roles getting hired today require a fundamentally different interview prep than the ones getting cut.

The engineers who survive this transition won't be the ones who learned the most AI tools. They'll be the ones who understood the problems well enough that the tools didn't matter. Junior engineers worry about which tool to learn. Senior engineers worry about which problems to solve. Staff engineers worry about which problems to prevent.

Figure out which category you're in. Then move up.

What's the biggest shift you've noticed in DE job descriptions over the last year? I'm curious whether the bifurcation looks the same from inside healthcare, fintech, and pure tech, or if it's playing out differently by industry.

Data Engineer LeetCode: What to Grind and What to Skip

DataDriven — Fri, 03 Jul 2026 17:06:34 +0000

I spent about 80 hours grinding LeetCode before my first FAANG data engineering loop. Binary trees, dynamic programming, graph traversal. I could reverse a linked list in my sleep. Then I walked into the interview and got asked to deduplicate a fact table with late-arriving records, design a pipeline for slowly changing dimensions, and write a window function I could have done in 10 minutes if I hadn't been so sleep-deprived from memorizing Dijkstra's algorithm the night before.

I bombed it. Not because I wasn't prepared. Because I prepared for the wrong test.

That was years ago, and the gap between what LeetCode tests and what data engineering interviews actually screen for has only gotten wider. In 2026, candidates are still burning hundreds of hours on problem types that virtually never surface in DE loops, while the skills that actually separate hire from no-hire get treated as afterthoughts. SQL fluency, data-manipulation Python, pipeline design thinking. That's where offers come from. Not from memorizing Dijkstra's.

Let me save you some time.

The LeetCode Mismatch Nobody Talks About Honestly

Here's the math that should make you angry: there are over 3,000 problems on LeetCode. The vast majority test binary tree traversal, dynamic programming, graph algorithms, and backtracking. Data engineering interviews rarely touch any of those categories.

62% of organizations prohibit AI use in technical interviews, while 76% of actual data engineering work is now enhanced by AI tools. So the interview tests skills the job doesn't use, in conditions the job doesn't impose. If an AI can spit out a clean solution to a medium LC problem, what does asking that problem actually tell anyone about the candidate? The signal has always been thin. Now it's basically noise.

The industry knows this. Between 2023 and 2026, the DE role shifted from "batch ETL plumber" to a blend of real-time architecture, cloud cost optimization, metadata governance, and platform engineering. None of that correlates to your ability to implement a trie. Companies are starting to act on it: Airbnb's loop dropped dedicated coding puzzle stages in favor of pipeline design rounds. Meta replaced traditional LeetCode screens with staged CodeSignal scenarios. Google now hands candidates multi-file codebases for refactoring instead of isolated algorithm puzzles.

But candidates? Still grinding binary trees at 2am.

The research is clear: 35 to 50 problems is sufficient for most data engineering roles. 10 to 15 easy, 20 to 25 medium, 5 to 10 hard. That's it. Skip trees, linked lists, graphs, and backtracking entirely unless a specific company tells you otherwise. Stick to arrays, hash maps, string manipulation, and sliding windows. These are the patterns that actually transfer to data work; the rest is noise you're studying to feel productive.

Dynamic programming is nearly useless for DE work but still appears in prep checklists. Most DP problems aren't applicable in real-world settings, yet candidates grind them out of habit, wasting 20 to 40 hours on dead-end prep. I know because I did exactly that. I memorized the knapsack problem. Never once used it. Not once.

The best data engineers often aren't strong at algorithm puzzles. The reverse is also true. Stop optimizing for the wrong metric.

SQL Is the Real Interview Gate

SQL appears in 69 to 79% of data engineer job postings. It shows up in 85% of full interview loops. Window functions appear on roughly 80% of technical screens. If you can't write ROW_NUMBER() or a rolling average with OVER(PARTITION BY ...) cold, you're going to struggle at any data-adjacent role. These aren't advanced anymore. They're table stakes.

The patterns that actually gate candidates are narrower than most people assume.

Window functions. ROW_NUMBER() vs. RANK() vs. DENSE_RANK(). Getting the wrong one when ties exist cascades into broken analytics. LAG and LEAD for sessionization and gap detection. This is the single skill that separates junior from intermediate in the eyes of most interviewers.

CTEs. Interviewers no longer accept nested subqueries as a clean approach. Break your logic into named steps. If your query reads like a paragraph instead of a matryoshka doll, you're already ahead of 60% of candidates. When I tried to submit my first bit of SQL to my code repository, the response I received must have been longer than the code submitted. I didn't understand the value of readability. I do now.

Join-grain awareness. One in three real SQL rounds opens with a problem where candidates inflate revenue by 3x because they joined at the wrong grain. The number one failure mode isn't syntax; it's not understanding the cardinality of the relationship before writing the JOIN.

Deduplication. If you're slapping DISTINCT on a query to hide a problem instead of solving it, the interviewer noticed. Use ROW_NUMBER() to deduplicate on a composite key. Know when your data has duplicates because of the source vs. because of your join.

NULL behavior. This one is a silent killer. A single NULL in a subquery makes NOT IN return zero rows. Not the filtered set you expected; zero rows. This defeats roughly one in five candidates. Use NOT EXISTS instead. It handles NULLs correctly and it's what your interviewer wants to see.

Here's what most candidates miss: clarification beats speed. If the question says "find the latest order," does "latest" mean by timestamp or by ID? Candidates who jump straight to coding burn 20 to 30 minutes solving the wrong problem. The ones who ask two questions first finish in 10.

Phone screens use 2 to 3 conceptual questions. On-sites use 4 to 6 hands-on problems. No binary trees. No DP. Just window functions, CTEs, grain, and dedup. That's the SQL interview study plan.

Python Rounds Want a Data Brain, Not an Algo Brain

Python appears in 74% of data engineer job postings and is required for senior roles. But the Python that matters in a DE interview is completely different from what SWE screens test.

Uber's data engineer screen asks candidates to transform transaction datasets and calculate custom metrics using Pandas. Stripe emphasizes clean, efficient Python with a focus on data structures and SQL first, then scalable pipeline design. No graph traversal. No dynamic programming. The actual screening questions look like work you'd do on the job: parse a messy log file, deduplicate records on a composite key, sessionize an event stream, walk a nested JSON structure.

Most candidates don't fail because they can't write Python. They fail on the one malformed row in a file of ten million. The interview tests whether you think about validation, error handling for bad data, and what happens when a field is missing or the wrong type. Can you quarantine bad records and keep the pipeline running? Or does your code silently drop 40% of rows because you assumed clean input?

I've seen candidates crush 100 LeetCode problems and then stumble on a composite-key deduplication task. They memorized algorithms; they never learned to think about data. The skills that gate most DE candidates (window functions, idiomatic Pandas, JSON schema handling, idempotent upsert logic) are entirely absent from the "hard" LeetCode catalog.

Here's the counterintuitive thing: SQL fluency now outweighs Python sophistication for most loops. Clean, efficient SQL signals maturity within 10 minutes. Advanced Python (decorators, asyncio, metaprogramming) rarely surfaces. If you have limited prep time, put 40% into SQL, 30% into Python data manipulation, 20% into system design, and 10% into behavioral. That split comes from analyzing actual interview loops, not from some prep course syllabus.

For the PySpark and data-manipulation side specifically, we put together targeted drills for exactly this kind of prep; datadriven.io is good for pyspark practice and the pattern-matching that actually transfers to live screens, so you're not wasting reps on algorithm trivia.

System Design Replaced the Algorithm Round

Here's the shift that caught everyone off guard: system design expectations moved down the seniority ladder. What used to screen only senior engineers now appears at mid-level interviews. Airbnb's final loop includes 5 to 7 rounds with 1 to 2 system design rounds heavily weighted for leveling decisions. At Meta, it's the highest-weighted round in modern senior loops. At Databricks, you're designing real-time fraud detection using Spark Structured Streaming, Kafka, and Delta Lake.

But DE system design isn't SWE system design. Strip back the "system design for software engineers" mentality. You don't need to hand-roll a message broker or explain Paxos consensus. You need to reason about slowly changing dimensions, schema drift handling, idempotent writes, and which warehouse suits the cardinality and latency profile of the problem. This knowledge comes from building pipelines, not reading papers.

71% of engineering leaders report AI is making it harder to assess candidates, which is accelerating the format shift. The old playbook (memorize algorithms, speed-run solutions, pray the interviewer asks something you've seen) is dying. The new playbook rewards systems thinking, cost reasoning, and the ability to navigate ambiguity. Communication, narration, and reasoning under pressure are now the primary differentiators; not whether you can implement quicksort from memory.

The candidates who get offers aren't the ones with perfect algorithm solutions. They're the ones who ask the right questions before writing anything. "What's the expected data volume? How fresh does the downstream consumer need it? What happens when the upstream schema changes without warning?" A candidate who stumbles on a medium-easy coding problem but reasons clearly through pipeline architecture gets hired over the person who solves the algorithm perfectly but can't articulate a single tradeoff.

Data modeling is the quiet kingmaker here. It's the most important part of any data engineering interview, and if you nail the technical coding but stumble on modeling, you likely won't get the offer. Getting the model wrong upstream means everything downstream is pain. I've watched people with 10 YOE get downleveled because they couldn't articulate schema design decisions under pressure. The interview is a different skill than the job.

Junior engineers worry about which tool to learn. Senior engineers worry about which problems to solve. Staff engineers worry about which problems to prevent.

The data engineering interview in 2026 tests whether you can think, not whether you can memorize. DP, binary trees, and graph algorithms burned hours of my life that I'll never get back. Window functions, CTE fluency, data-manipulation Python, and pipeline design thinking are what got me hired. Repeatedly.

If you're in the middle of a job search right now, reclaim your prep time. Drop the hard LeetCode grind, double down on SQL patterns and pipeline architecture, and treat interviewing like the separate skill it is. The tools change every 18 months. The problems don't. Schema drift, late-arriving data, upstream teams breaking contracts without telling you. These are eternal. Study the eternal stuff.

What's the single interview question that caught you most off-guard in a DE loop? The ones nobody warned you about are the ones worth sharing.

DE Interviews Dropped DSA. The Replacement Is a Mess.

DataDriven — Tue, 30 Jun 2026 10:07:17 +0000

I did somewhere around 20 interview loops in a single job search. Some tested me on binary trees. Some tested me on pipeline architecture. One company asked me to build a full data warehouse from scratch in a take-home, then ghosted me. Another had me whiteboard a Spark optimization problem, then admitted in the debrief that they don't use Spark. The only consistent thing about data engineering interviews in 2025 and 2026 is that nothing is consistent.

The industry quietly dropped DSA rounds from DE hiring pipelines. You'd think that would be good news. Data engineers don't implement Dijkstra's algorithm at work. We debug pipelines that silently drop records, negotiate schema contracts with upstream teams who don't know we exist, and model data so finance can build board decks without calling us at midnight. LeetCode mediums were always an imported ritual from software engineering, never validated for our work.

But here's the thing nobody warned you about: the replacement is worse.

Why DE Interviews Ever Tested DSA

Data engineering solidified as a distinct role somewhere around 2015 to 2020. That's recent. Software engineering has 40+ years of structured interview evolution. When companies needed to hire DEs, they didn't design DE-specific screening. They copy-pasted the SWE playbook. LeetCode reached a million users within two years of launch, and suddenly every technical role in tech was getting filtered through binary tree traversals and dynamic programming problems.

The logic was lazy but understandable: "Smart people can solve algorithm problems. We want smart people. Therefore, algorithm problems." Nobody asked whether the signal was relevant. 78% of developers report that interview assessments don't match real-world job work, and 56% say algorithm questions are "not useful for their jobs." For data engineers, that number should be higher. We rarely write complex algorithms from scratch; we use pre-built libraries and frameworks. The skill is knowing which tool to reach for and how to model the data correctly, not implementing a red-black tree.

Inertia kept DSA in place for years. Not evidence. Algorithm interviews are easy to design, easy to administer, and easy to score. They have clear right answers. They let hiring committees feel rigorous without doing the hard work of defining what "good DE" actually looks like. Seven out of ten companies were still screening data engineers the same way they did in 2022, even as the role itself morphed from "batch ETL plumber" to something combining real-time architecture, cloud cost optimization, metadata governance, and AI integration.

Then AI made the whole thing absurd. If Claude can solve a medium LC problem in seconds, what does asking it tell you about the candidate? Companies like Meta, Google, Canva, and Shopify started permitting AI use in live technical sessions. Canva replaced their "Computer Science Fundamentals" round with "AI-Assisted Coding" in mid-2025. The premise that raw algorithmic ability was being measured collapsed overnight.

DSA was never the right test for data engineering. It was the convenient one. And when convenience stopped working, nobody had a Plan B.

What Companies Replaced the LeetCode Round With (And Why It's a Mess)

Here's where the story gets ugly. Companies dropped DSA and replaced it with whatever their hiring manager felt like that quarter. There is no standard. There is no consensus. There is barely even a pattern.

Some companies pivoted to system design rounds. Fine in theory; pipeline architecture is genuinely relevant to the job. But system design has no rubric. No "correct" answer. Every interviewer has a different opinion on whether you should optimize for cost, latency, or data freshness. At least with LeetCode, everyone agreed what a good answer looked like. System design is subjective hell, and candidates walk out of those rounds with zero idea whether they passed.

Other companies went all-in on take-home projects. These started as 2 to 3 hour exercises and ballooned into 10 to 20 hour ordeals: full pipeline implementations, multi-source data modeling, documentation, testing, and presentation follow-ups. That's not an interview; that's free proof-of-concept work. And the rejection email is still a template with no feedback.

Here's the part that should make you angry: take-homes are worse for equity than live coding. A structured live interview can be leveled with a rubric. A 20-hour take-home is a time tax that penalizes caregivers, people working second jobs, and anyone without unlimited buffer hours. Companies adopted take-homes thinking they were more fair. The irony is thick.

The numbers paint the chaos clearly. SQL shows up in 85% of loops. System design in 65%. Python in 70%. Data modeling in 55%. Take-homes in about 25%. Enterprise hiring timelines now stretch 60 to 90 days with 5 to 7 rounds, while the best candidates leave the market in 10 to 14 days. The process is optimized for companies feeling thorough, not for actually hiring.

And the single most important DE skill, data modeling, is missing from two-thirds of interview loops. Only about 33% include a dedicated data modeling round. You can nail the coding, ace the system design whiteboard, and still lose the offer because you stumbled on modeling. But nobody told you that was the real test, because it's buried inside other rounds instead of being evaluated explicitly.

The role definition chaos explains the interview chaos. Between 2023 and 2026, the industry moved DE from "batch ETL" to a role combining real-time architecture, AI pipelines, metadata governance, and cost optimization. Companies testing SQL plus system design plus AI-assisted builds are simultaneously hiring for three different job titles. No wonder candidates prep for interviews that don't exist once they're hired.

AI Broke the Fallback Too

Take-homes were supposed to be the safe harbor. Let candidates work in their natural environment, at their own pace, showing real engineering judgment. That premise died when LLMs got good enough to build a passable data pipeline in 20 minutes.

The numbers are damning. 80% of candidates use LLMs on take-home tests despite explicit prohibition. AI-assisted cheating adoption jumped from 15% in June 2025 to 35% by December 2025, and by late 2026 it's headed past 50%. In unproctored take-home formats, estimated fraud rates sit between 60% and 80%. And 61% of cheaters scored above passing thresholds without detection.

Companies responded with policies that are pure theater. 64% of companies attempt to ban AI in interviews, but there's zero correlation between having an explicit no-AI policy and lower cheating rates. The 80% use-despite-ban number tells you everything: candidates view bans as unenforceable, because they are. Tools like Cluely and Final Round AI cost $20 to $50 a month and feed answers via invisible screen overlays. Keystroke dynamics, perplexity scoring, gaze tracking; every detection method has documented, production bypasses.

Greenhouse's June 2026 report found 80% of US candidates say employer AI policies are vague, rare, or completely absent. Companies blame candidates for guessing; candidates blame companies for silence. Meanwhile, 41% of companies now require a hybrid model: asynchronous take-home plus live defense session, specifically because unproctored take-homes alone produce no reliable signal. That's not marketed as "AI-proofing." It's just the new floor.

The job market itself is training candidates to cheat. When 30% of candidates drop out of hiring processes after discovering AI-led screening, and take-homes are the fallback, the lesson is clear: assume no human will review this carefully and act accordingly. The policy vacuum creates the behavior.

64% ban LLMs. 80% use them anyway. That's not a policy; it's a suggestion.

What to Actually Prep for When the Interview Has No Standard

I'll be blunt: the chaos is the prep. You can't study for a standardized loop because there isn't one. But you can build a stack of skills that covers the majority of what companies actually test, regardless of which format they chose this quarter.

SQL is still the universal filter. It appears in 85% of loops. Not "write a SELECT statement" SQL; deep SQL. Window functions, CTEs, query optimization, understanding execution plans. This is the one skill that transfers across every company and every format, which is exactly why we made sure DataDriven is good for sql interview practice that reflects what companies actually ask rather than textbook exercises disconnected from real pipelines.

Data modeling is the hidden pass/fail. It's only an explicit round in a third of loops, but it's the implicit evaluation in every system design and take-home. Getting the model wrong upstream means everything downstream is pain. Practice designing schemas for real business scenarios: slowly changing dimensions, event streams, aggregation trade-offs. If you can't explain why you chose a grain, you're not ready.

System design means pipeline architecture, not load balancers. Strip back the "system design for software engineers" mentality. DEs don't care about reverse proxies. You need to design ingestion, transformation, serving layers, and failure handling. Practice narrating your design decisions out loud. The signal in system design rounds is communication under ambiguity, not arriving at the "right" architecture.

Learn to debug, not just build. The actual job is less "write a DAG" and more "figure out why this pipeline silently dropped 2M rows last Tuesday." Schema drift, late-arriving data, upstream teams breaking contracts without telling you; these are eternal. No interview tests for this explicitly, but candidates who can reason about failure modes stand out in every format.

Treat interviewing as a separate skill from the job. I've watched people with 10 YOE get downleveled because they couldn't articulate system design decisions under pressure. The career progression from senior to staff depends on your ability to communicate tradeoffs, not just execute them. Practice talking through your work. Record yourself explaining a pipeline you built. It feels stupid. It works.

The LeetCode era had one advantage: predictability. You knew the game, you ground the reps, you played to win. The post-DSA era took that away without replacing it with anything coherent. That's frustrating. It's also the reality.

The companies that figure this out first will attract the best talent. The ones still running 7-round loops with no rubric and 20-hour take-homes will keep wondering why their offers get declined.

What's the most absurd interview format you've encountered since companies started dropping DSA rounds?

Data Engineer Salaries in 2026: The Numbers Are Lying

DataDriven — Thu, 25 Jun 2026 10:07:39 +0000

Last year I was helping a friend prep for senior data engineer interviews. He'd been building pipelines at a Series B for four years, solid production experience, and wanted to know what number to put in the salary field. So he did what everyone does: checked Glassdoor, Indeed, PayScale, and Levels.fyi.

He got four numbers. They disagreed by over $120,000.

Glassdoor said $133K. PayScale said $100K. Indeed's senior number sat at $216K. Levels.fyi split the difference at $157K. Same title, same country, same year; four answers that can't all be right. And here's the thing: none of them are lying. They're just counting different people, over different time windows, with different biases baked in. The result is that candidates trying to benchmark their data engineer salary are pricing themselves against a number that doesn't represent their actual market.

This is a problem. In a hiring environment where 52,050 tech workers got laid off in Q1 2026 alone, where senior roles take 60 to 90 days to fill, and where title inflation has made "data engineer" mean three different jobs depending on who's posting, getting your number wrong has real career cost. You either leave $30K on the table or you overshoot and get ghosted. Both outcomes trace back to the same root cause: the data you're benchmarking against is broken.

Why Every Salary Site Disagrees by $120K

Each major compensation source has its own rot problem. Understanding the bias is more useful than trusting the number.

Glassdoor reports $133,484 average across 32,984 submissions. The issue: it's entirely self-reported, and higher earners submit more frequently. The person who just got a $180K offer is more motivated to log it than the person who accepted $115K and moved on. The sample skews up.

PayScale reports roughly $100K. That sounds low because it is; 71% of their data engineering respondents are mid-level or junior. PayScale validates every data point and refreshes on sub-90-day cycles, which makes it the most accurate floor for what actually clears at offer stage. But candidates see $100K and panic. They shouldn't. They're looking at a junior-weighted average.

Indeed sits at $216K for senior roles. The problem here is temporal: Indeed averages job postings going back 36 months. Their June 2026 number includes postings from June 2023, before the layoff waves, before signing bonus compression, before the market shifted. You're benchmarking against fossil data.

Levels.fyi pegs the median at $157,450, but this population skews heavily toward top-tier tech companies and excludes non-tech firms where data engineers earn 20 to 35% less. Google's median is $278K. Capital One's is $130K. That's a $148K spread for the same title on the same platform.

The salary data isn't wrong. It's measuring different populations, different time windows, and different definitions of the job. Once you know which population you're in, the number becomes useful. Until then, it's noise.

The practical damage is real. A mid-market data engineer sees Glassdoor's $133K, anchors there, and never learns that the number includes FAANG outliers pulling the average up. Or worse, they see Indeed's $216K senior figure and counter-offer at a number that makes the hiring manager close the tab.

Role Title Chaos Is Pricing You Against the Wrong Pool

Here's the less obvious problem: the job you're benchmarking might not even be the job you're doing.

Analytics engineers earn $155K to $195K median in 2026. ML engineers command a 38% salary premium over data engineers at mid-career. Data scientists occupy yet another band. These are different roles with different compensation structures. But companies routinely mislabel them.

Analytics engineer postings grew 114% from 2023 to 2024, yet dbt Labs openly admits the title boundaries are blurring. Analysts drift into dbt modeling. Data engineers adopt dbt as standard tooling. The result: a "$150K dbt role" could be transformation work (analytics engineer) or pipeline infrastructure (data engineer), and the salary sites have no idea which one they're counting.

37,000 data engineering jobs post monthly on average, but a significant portion of those are mislabeled analytics engineer, ML engineer, or data scientist roles. When a company posts "Senior Data Engineer" but the job is really dbt plus Snowflake plus stakeholder dashboards, that's an analytics engineer role at data engineer pricing. The candidate benchmarks against infrastructure DE salaries ($115K to $160K) when they should be benchmarking against analytics engineer salaries ($155K to $195K). That's a $30K to $40K miss.

The reverse kills you too. An analytics engineer who sees ML engineer salary data and anchors at $190K gets rejected as "overpriced" for the actual scope.

The litmus test isn't the title. It's the job description. If it says dbt, Snowflake, and "stakeholder reporting," you're an analytics engineer regardless of what the posting calls you. Benchmark accordingly.

2023 Job Ads Are Still Haunting Your 2026 Number

Indeed's 36-month lookback window deserves its own section because the implications are worse than they look.

In 2023, the median data engineer salary was $117,446. By June 2026, Indeed reports $136,776. That looks like 16.5% growth over three years, which isn't terrible. But the number is being held down by every posting from 2023 and 2024 that's still sitting in the average.

Here's what makes this especially misleading: 68% of tech job postings included explicit salary ranges in 2025, up from 45% in 2023. Pay transparency laws made the data more granular. But Indeed weights all 36 months equally. A vague salary range guess from a 2023 pre-transparency posting counts the same as a precise, legally mandated range from 2026. Higher sample size, stale composition.

Then there's the ghost job problem. One-third of employers admit to posting inactive roles. Greenhouse data found 18 to 22% of listings are never filled. Stale 2023 postings are more likely to be dormant, and they're inflating the denominator. You're benchmarking against jobs that don't exist anymore.

The senior role divergence tells the real story. The $60K gap between mid-level ($133K) and senior ($175K) data engineers in 2026 suggests the market has repriced for experience. But the aggregate average is anchored by fossils. If you're mid-career, the number you see is artificially low.

Layoffs Created a Tier, Not a Glut

52,050 tech workers laid off in Q1 2026. A 40% jump over Q1 2025. Oracle cut 21,000. Amazon cut 16,000. Dell cut 11,000. Sounds like a buyer's market.

It's not. Or at least, not uniformly.

Those 52K cuts coexist with 67,000 active software engineering job postings in the same quarter, the highest posting volume in three years. Companies are cutting commoditized roles while hoarding data engineers, ML engineers, and security specialists. A junior full-stack engineer is in a buyer's market; a senior data engineer with Airflow and Spark experience is not. The "layoff market" narrative breaks down completely by skill tier.

But here's the asymmetry that actually matters: companies take 60 to 90 days to fill senior roles because they're running multiple candidates in parallel. Individual candidates spend 3 to 9 months searching. The employer can wait. The candidate runs out of severance. That's where negotiation leverage shifts; not because the market is soft, but because one side has a deadline and the other doesn't.

The data on negotiation is striking. Data engineers who negotiate earn $24,479 more annually, an 18.83% increase. 85% of counter-offers get at least partial acceptance. 70% of hiring managers expect you to negotiate. Only 44% of candidates actually do it. The $120K gap between salary sources is partly a measurement problem, sure. But it's also partly behavioral. The spread between 25th and 75th percentile reflects negotiation winners vs. passive accepters, not just market fragmentation.

Engineers with current cloud and security skills close offers in 2 to 4 weeks. Everyone else faces the full timeline. Skill specificity determines leverage more than market conditions.

What Number to Actually Put in the Field

Stop averaging the averages. Here's the hierarchy of sources, from most to least useful for your career planning:

Levels.fyi is best for FAANG and top-tier tech. Filter by company, level, and location. The by-company variance is massive ($278K at Google vs. $130K at Capital One), so the aggregate median is useless. You need the company-specific number.

Glassdoor is useful for the 25th to 75th percentile range at your target company, if they have enough submissions. The $141K to $219K senior DE range tells you more than the $175K mean.

PayScale is the most accurate floor. If you're at a non-tech company or early in your career, this is closer to your reality.

Indeed is the least useful for current benchmarking. The 36-month window buries the signal.

The actual number you put in the field should be the Levels.fyi or Glassdoor 75th percentile for the specific company, then negotiate. If 70% of hiring managers expect negotiation, pricing yourself at the median is pricing yourself to get negotiated down.

And one more thing the salary sites never show you: base salary is barely over half the employer's total cost to hire. That $200K base offer costs the company $240K to $290K when you add payroll tax, benefits, recruiting fees (18 to 25% of first-year base), and onboarding ramp. They have more room than you think. The question is whether you know enough about your own market to ask for it.

If you're prepping for the senior and staff loops where compensation actually diverges, strip back the "system design for software engineers" mentality; we built system design for data engineers with datadriven around pipeline architecture problems, not the load-balancer trivia that SWE prep loves and DEs never face on the job.

The salary data is broken. The titles are broken. The timelines are longer. None of that changes the fact that data engineering compensation is strong and growing for engineers who know what they're actually worth. The trick is figuring out which population you belong to, not which average to believe.

What's the biggest gap you've seen between what a salary site reported and what you actually earned or were offered?