loading...

The Oracle at Delphi, or How I Learned to Stop Worrying and…accept…NoSQL

daveross profile image Dave Ross ・3 min read

My first exposure to enterprise-scale web development was in the early 2000s, when the company I worked for migrated our order processing & customer service system from green screens to J2EE. A rack at the corner of our datacenter housed its servers: 1U webheads named after Greek city-states like Athens and Sparta, and a giant 4U Sun V480 database server called Delphi, because it's where you would find Oracle.

Delphi contained two SPARC 9 CPUs and multiple gigabytes of RAM. For storage, gigabit Ethernet linked it to a SAN so densely populated we had to reinforce the floor beneath it. It was a hot rod of data processing power, dwarfing the Sun 220R web servers physically and in terms of capability.

The prevailing wisdom was to invest heavily in your database tier:

  • Multiple fast CPUs to parse and execute queries
  • Generous RAM to cache common queries
  • Redundant, performant storage for all your valuable data

I was taking night classes toward a bachelor's degree at the time, and had two semesters on database theory. We learned things like relational algebra and how to partition data using formulas originally derived to track viral epidemics. I was heavily invested in the RDBMS world when NoSQL came along. NoSQL sounded like the messy Pick databases I dealt with at the dawn of my career. It threw away the accumulated wisdom from decades of RDBMS development. I was skeptical, but I'm starting to warm up to this SQL-less, often schema-free world.

My moment of clarity came when I spec'ed out a couple AWS instances for a web app. As I considered our needs for multiple cores and gigabytes of RAM, I realized all the power of Delphi was now in our web tier and Delphi's novel gigabit data pipeline was obsolete. Yesterday's hardware demanded that we crunch data in the database tier and send the smallest result set possible over the wire. Today's hosting options make it possible – and affordable – to pull a set of records out of storage and iterate over them in the web tier, using the same language the rest of the app is written in and taking advantage of the app's own caching infrastructure.

Remember DBAs? We used to need a full-time employee just to tune that database server for our workloads and tweak our queries for efficiency. These creatures were the bane of developers, and they lived to EXPLAIN how the DBMS executed each line of SQL. Moving the record selection logic into the codebase obviates the need for a dedicated DBA; optimizing selection becomes part of a code review instead of a dedicated role.

So, while I'll always miss the hum of that data crunching behemoth, I recognize it's a relic. And, so is the way I used to think about databases. NoSQL stuck around because it's not a fad, it reflects an industry adapting to the ridiculous amount of cheap processing power at our hands. If an old-timer like me can learn to – if not love, at least accept – this new world, I hope every other graying code monkey out there will take a second look and understand NoSQL's place in today's web stacks.

Posted on by:

daveross profile

Dave Ross

@daveross

Building the web since 1996. Full-stack developer, but love front-end tech. I also socialize feral and abused cats. Associate Director of Engineering at 10up.

Discussion

markdown guide
 

Can you give an example of component uri encoding decoding security and parsing for page regions or components ?

The 2018 spec is intentionally silent. The need and possibility as well as its ability to unify parse and render through generators and string template tag functions seems like well awesome and amazing

As a new Dev who in two years has rewritten and rewritten like 250,000 lines of code "refactored" to like 3500 useful, including four own parser and universal templating system for building components and parsing English, I am just a bit overwhelmed by adopting the encoding and new library integrations for coming advanced interfaces on webgl.

I could bang my head abs worry for a week or ask you. You have the experience to just know this was a touted web gl feature and URL topic all 2012