A Comprehensive DevRel Metrics Guide (Part 2): DevRel Metrics to Track?

Now that we got the Why? out of the way. Let's face the difficult challenge on what DevRel-Metrics we should collect in the first place.

Of course I will stand on the shoulders of giants here again as a lot of smart DevRel-practitioners have already written about this.

The goal of this post is to get to a common understanding what others usually track. I also want to give you my opinion on metrics as I think there is so much confusion about metrics. I believe that a pragmatic approach is reasonable to be practical for each individual situation.

We will discuss the following things:

1. DevRel-North Star metrics: Why they are useful but not sufficient
2. Common metrics that are collected in the industry
3. My critique and opinion about this

DevRel-North Star Metrics

Swyx claims nearly all companies settle on one specific metric: Monthly Active Developers (Source: Measuring DevRel by swyx)

Also popular:

• Registered Developer Accounts (Source: Slashdata Report 2020)
• Developer Satisfaction score (Source: Slashdata Report 2020)
• Time To Hello World (TTHW) (Source: Sean Falconers - DevRel Metrics And Why They Matter)
• Time to First WOW! Exclamation (TTFWE) (My own invention: The first time a user experiences and realizes the value of your product.)
• Number of signups / registrations (Source: Kim Maidas Keystone Framework)
• ...

Also, have a look at DevRel-KPIs.com for more inspiration.

Common Metrics in the Industry

So this may be useful when you have to report one or two numbers to management, but not sufficient for what DevRel is actually doing in their day-to-day work.

Many more metrics have been collected and I will just link them here for you to explore and get an idea:

I really like the DevRel-Metrics swyx compiled for his North Start-metric Monthly Active Developers

Metrics that feed into Monthly Active Developers North Star Metric.(Source: [Measuring DevRel by swyx](https://www.swyx.io/measuring-devrel))

From Kim Maidas Keystone Framework:

• Reach
• Awareness
• Engagement
• DevRel Qualified Leads

Also again DevRel-KPIs.com is a great resource to get you going.

Are There Bad Metrics

I would say It depends :-P

Usually you do not want to be measured with a marketing metric. We are dealing with relations here, remember?
But if we produce content for example that is for creating awareness or inspiration. What metrics can we actually collect to measure its success? In my opinion this would be something like views or likes or Github-stars.

So I suggest the following: Be pragmatic with what you track. There is no harm in collecting a marketing metric if it fits your current situation. If management cares about these sometimes so called Vanity Metrics, even better. Easy to collect and report on.

But do not get caught up in them! An audience is not a community and you want to foster real relationships :-)

My Critique and Opinion About This

It always felt wrong as a software developer to reduce a complex topic into a single number. It feels even more so with DevRel. I get that management would like to have a single number to gauge how DevRel is doing. But DevRel performs a cross-functional function in a company. The metrics are influenced by a lot of departments and also ultimately by the state your product is in.

A metric like Monthly Active Developers is a great metric if the management trusts that you influence it positively. The problem is, that it is usually influenced by a lot of departments like product, support, technical writing, marketing and so forth. If your product has sharp edges you can not work around even with the best onboarding and with the best feedback for engineering you can possibly provide: Good luck with improving your TTHW!

Also tieing your activities to a North Star metric may sometimes be hard as it can lag significantly behind as not every relationship or piece of content has impact immediately. Often it is a compounding effect of positive encounters that tips the scale.

Conclusion Part 2

In this post we discussed popular DevRel-North Star metrics like Monthly Active Developers used in the industry. They are useful when reporting to management, but not sufficient to measure the complex day-to-day work or specific project/campaigns DevRel is focusing on in a specific company.

We gave a lot of pointers on what you can also collect with the general recommmendation to be pragmatic and, if possible, to focus on metrics that cover relationships.

In the next part of this series we will cover Kim Maidas Keystone Framework. It is a great framework if you are just starting out! I use it with a few extensions. It is useful in my current situation and it includes the Relations part of a DevRel-Practitioner!

Photo by Igor Mashkov: https://www.pexels.com/photo/radio-telescope-against-sky-with-stars-6325001/