DEV Community

Cover image for Down the Rabbit Hole: Building the Reference List for the Pair-Programming Book
Sebastian Schürmann
Sebastian Schürmann

Posted on

Down the Rabbit Hole: Building the Reference List for the Pair-Programming Book

There's a particular kind of humbling that happens when you sit down to write a book and realize you need to actually read the papers you've been casually citing for years.

That's more or less where I found myself when I started assembling the reference list for the Pair Programming Book. What started as "I'll just gather the key papers" turned into a months-long excavation through decades of software engineering research. The current estimate: somewhere between 250 and 500 relevant papers. And counting.

Here's what that journey looked like.

The Papers You Know But Haven't Read

Every field has its citation folklore — papers so frequently referenced that they've achieved the status of common knowledge without anyone actually opening them. Pair programming research is no exception.

I had a mental list of "classics" I'd been nodding at for years. Williams et al., 2000. Cockburn and Williams. The early XP studies. I knew their conclusions the way you know the plot of a movie you've never seen — through cultural osmosis, hallway conversations, and abstracts alone.

Actually reading them was a different experience. Some held up beautifully. Others were more nuanced, more conditional, more contested than the canonical summary suggested. A few conclusions that had calcified into "everyone knows that pair programming does X" turned out to rest on a single study with 41 undergraduates.

The lesson: citation chains in a young field are fragile things. You owe it to your readers — and yourself — to go back to the source.

Laurie Williams Deserves a Prize

If pair programming research has a GOAT, it is, without question, Laurie Williams.

The sheer volume of rigorous, foundational work she has produced on the subject is staggering. While others were still debating whether pair programming was a gimmick, Williams was running controlled studies, developing frameworks, and building the empirical case that made the whole conversation possible. Decade after decade.

Writing this book without her work would be like writing about relativity and hoping Einstein doesn't come up. She doesn't just appear in the bibliography — she is a substantial portion of it.

If there is ever a formal prize for contributions to software engineering research, the pair programming category should be named after her.

The Questionable Corners of the Literature

Not every paper in the pile earned its place gracefully.

Some announced themselves with titles that made me wince before I even opened the PDF. You know the genre. A combination of buzzwords, a forced acronym, and a vague promise of insight that the abstract doesn't quite deliver on. I won't name names. But I have a folder.

More substantively: a surprising amount of pair programming research is built on frameworks that the broader scientific community has quietly retired. Personality type taxonomies are the main offender. Myers-Briggs in particular makes repeated appearances — studies earnestly classifying programmers into 16 types and drawing conclusions about pairing compatibility. The problem is that the psychometric foundation for these instruments has been thoroughly undermined. They're not useless as casual conversation tools, but basing empirical research claims on them is shaky ground.

The same applies to some of the "introvert vs. extrovert" dichotomy work, which tends to treat personality as a binary switch rather than the distributed, context-dependent trait that modern personality psychology describes.

This doesn't mean the research is worthless — often the observations are real even when the interpretive framework is suspect. But it does mean a lot of careful reading, and a lot of footnotes that essentially say: the finding is interesting, the taxonomy it's hung on is not.

What 250–500 Papers Looks Like

It looks like a lot of tabs.

It also looks, honestly, like a field that is richer and more contested than its popular summary suggests. Pair programming is not simply "proven effective" or "proven ineffective." The evidence is contextual, domain-specific, experience-level-dependent, and shaped enormously by how you define and measure "effective" in the first place.

That complexity is exactly why the book needs to exist. The practitioner literature tends toward confident prescriptions. The academic literature is full of hedges, replications, and contradictions that rarely make it into the conference talk or the blog post.

The reference list is the honest accounting of that complexity. Every citation is a commitment: I looked at this, I understand what it claims, and I'm representing it faithfully.

That's the job. It's slower than I expected. It's also more interesting.

Top comments (0)