DEV Community: Cully

Shifting info arch to match user personas

Cully — Mon, 10 May 2021 16:30:07 +0000

A few weeks ago, around the end of March 2021, I set my focus on finally refreshing the information around Temporal's core concepts. Refreshing the core concepts documentation area had become a major priority in my mind. The area had largely gone untouched in the last couple of years, and user feedback suggested it consisted of far too many industry terms laden with heavy connotations and lacking in practical purpose and use case.

I figured the best place to start was with Workflows. As I tried to wrap my head around the best approach to introduce this concept to a new user, I fell back on a first principle to writing documentation, asking myself "what does it do?"

And this is when a wave of realization crashed over me. Like a surfer working their way past the break line, I had been bobbing about in between sets and another had just rolled in.

I had to take a breath, duck under the wall of white water and try and find my angle of approach, suddenly aware that if we didn't get past the break line soon, we may be stuck here for awhile.

The realization was that the answer to my question was already fairly well defined across any number of resources; A "workflow" is a sequence of processes, from initiation to completion, through which a piece of work passes. A Temporal Workflow is just that, hence the name. Within the context of Temporal, it is how that happens, and why it happens in the way that is does that is the secret sauce.

However, one must learn not only of Temporal's overall strategy, but also language specific implementation details simultaneously to get a taste of that secret sauce. At the time of writing this, we supported three implementation languages with a fourth on the way, with each language presenting its own unique way of defining and writing Workflows. My instinct was that something fundamental was off in the current approach to presenting this information.

I needed to think.
So, I went for a run.

With my legs pumping freshly oxygenated blood through my brain, my heart, and my veins, I set my mind to the task at hand. I tried to come at the problem from a new user's perspective. This is how I discovered a problem that I hadn't fully noticed before.

User personas

The thing is, not all users are after the same information. Unlike many other technologies, we don't offer a single service or API endpoint. Temporal's boundaries are high and wide, and there are at least four unique user groups accessing the documentation.

Infrastructure and operations engineers looking to deploy and operate their own Temporal Server cluster.
Developers and software engineers looking to start building applications.
Operators and SREs looking to troubleshoot, debug, or generally monitor the system's health.
Business decision makers evaluating the technology as a whole or considering the use of our cloud service (still in beta).

A single person may bridge multiple personas, but while embodying one, they won't want to be bogged down by information directed at the other. This particular aspect of our users convinced me that in order to meet our user's information needs, separating content based on our user's personas was the first step towards a fundamentally sound base to build off of.

Building documentation is an iterative process.
And, up until that point, we had iterated our documentation such that this is what our landing page looked like:

It's not entirely bad. But, as you can see, it doesn't provide a very clear path for a new user with a particular agenda.
Someone might spend a good deal of effort wading through the full spectrum of information to potentially find what they are looking for. Thus, I decided, information architecture was a key variable in this equation.

Now you're speaking my language

Now that I was convinced that changes were needed to our information architecture to address our user's personas more appropriately, I revisited the problem of our core concepts.

At this stage, I was able to make the following connections:

From an application development perspective, everything boils down to about six core concepts:
- Workflows
- Activities
- Workers
- Task Queues
- Signals
- Queries
The developer/software engineer persona is the one who is primarily concerned with internalizing and fully understanding these concepts.
One can only fully describe any of these concepts within the context of a particular language.
A developer is almost certainly only going to be interested in learning in a single language.

Look at how a Workflow is defined across each language:

Go:

func SimpleWorkflow(ctx workflow.Context, someArg string) (string, error) {
  // Do something
  if err != nil {
    return "", err
  }
  return "success", nil
}

Java:

@WorkflowInterface
public interface SimpleWorkflow {

    @WorkflowMethod
    String simpleWorkflowMethod(String someArg);

}

public static class SimpleWorkflowImpl implements SimpleWorkflow {

   @Override
   public String simpleWorkflowMethod(String someArg) {
       // Do the stuff
       return something
   }
}

PHP:

#[WorkflowInterface]
interface SimpleWorkflowInterface {

    #[WorkflowMethod]
    #[ReturnType("string")]
    public function simpleWorkflowMethod(string $someArg);
}

class SimpleWorkflow implements SimpleWorkflowInterface
{

    public function __construct()
    {
        // Do stuff
    }

    public function simpleWorkflowMethod(string $someArg): \Generator
    {
        // Do stuff
        return something;
    }
}

While, one could tabulate between languages within a concept like above, as you get into the details, it becomes much more complicated. Additionally, not all features are available across each language, like Sessions in Go for example. And, because the implementation details and terminology can be so different from language to language, the obvious solution presented itself:

Each language should be visually separated from the others as its own topic area.
We must present each of these core concepts within the context of each language specifically.

At the same time, we couldn't just abandon a high-level concepts section, because from a practical perspective we need to be able to offer a linkable landing page for each concept that is still independent of a specific language. Imagine trying to share Temporal with someone but only having a language specific link to provide. That would create a bit of a conundrum for those trying to share our page links.

Thus, our core concepts section would become a sort directory for each of the languages, directing developers to language specific concept pages.

April 2021 changes

In April, the Temporal Product Team set about iterating towards these solutions. And we are excited with the results!

We redesigned our documentation landing page, docs.temporal.io:

We implemented a new SDK landing page, docs.temporal.io/application-development:

And we created a much more immersive experience for the user personas that we identified above:

Go developers for example, docs.temporal.io/go:

Infra engineers for example, docs.temporal.io/server:

And we started converting the core concepts into a directory for new users learning about Temporal:

Still day one

We have finally arrived at a place where there is an information architecture that fundamentally matches our user's personas. With this change in focus, our hope is that learning about the how and why of a particular concept becomes a much more rewarding and informative experience.

We know we have a LOT more work to do. We still lack full coverage of the concepts within each language, and the navigation and search experience can be made more intuitive.
If you have ideas for how to improve them, email us!

The process of creating SDK tutorials for new users

Cully — Thu, 12 Nov 2020 17:34:58 +0000

In early September it was clear that V1 of Temporal would be ready by the end of that month. This also meant that we would be announcing our funding shortly thereafter. From a documentation perspective, we felt that it was important to coordinate changes in a way that would support the announcement. As with any product launch, we were hoping to create some buzz and see a surge in new users. Considering that documentation is one of the most important aspects of new user adoption, we had our work cut out for us.

Uphill challenges

In terms of our documentation, there were at least three challenges we were facing. Two of those challenges stemmed directly from the fact that our docs started as a fork of the docs from Temporal's predecessor.

The first challenge is that the information we inherited lagged behind in fully describing Temporal's capability and feature set. One of the reasons for this is that documentation is typically offered a secondary level of prioritization. While Temporal now prioritizes documentation, this was not always true from where Temporal originated as Cadence.

The second challenge was that there have been many core changes to the system, terminology, and SDKs in the time since Temporal forked from its predecessor. Back in early September, many of these changes had yet to be propagated throughout the docs as well. So, not only was there missing information but some of the existing information was just plain incorrect.

The final and biggest challenge of documenting Temporal is that it is fundamentally new. Temporal presents a different approach to application development. Users are faced with a set of familiar terms and concepts but must comprehend them in an entirely new context and landscape.

Picking a path

At a high level, there are two parts to Temporal: the backend and a client-side SDK. Configuring, deploying, and operating the Temporal backend for a live environment is no small task. On the other hand, it is really easy to get Temporal running on your local machine in a Docker container. In fact, you can do it with just two terminal commands.

The Docker route definitely simplifies running the backend, which means the majority of friction for new users comes from our SDKs (Go, Java). While an SDK is meant to abstract the complexities of interacting with the server API, Temporal flips a lot of the preconceived notions of modern application development on their head. The SDK docs needed to do more than just provide example usage. They also needed to show the "why" to enable the user to grasp the concepts that Temporal is promoting. So we went about scoping something that we could realistically accomplish within that time frame and still be relatively effective.

We decided that the best thing for us to focus on was a great new user experience. We wanted something that would enable a developer to start using the product right away but also leave them with an understanding of the value Temporal provides. We wanted to cultivate that "aha!" moment.

We started as most might, by trying to envision what the ideal new user experience would look like. We then identified as many of the steps it would take to get there as possible. Looking back, I would contend that we managed to lock onto three ideas that we thought would get us closer to the ideal experience. The hope was that once these three ideas were combined they would result in a set of effective SDK tutorials for new users.

Snipsync

It was around this time (early September), that I was testing out a NodeJS tool I had built to improve the experience of creating and maintaining documentation. It downloads Github repos, scrapes code snippets that exist between specific comment wrappers, and writes the snippets to their corresponding comment wrappers in Markdown files.

// @@@SNIPSTART unique-name-of-snippet
SomeFunc() {}
// @@@SNIPEND

<!--SNIPSTART unique-name-of-snippet-->
<!--SNIPEND-->

We borrowed the idea from Google's proprietary version they use for their Google Cloud documentation. The concept is fairly simple, and I am still surprised that there was no existing open-source solution. So we made one!

A tool that automates the synchronization of code with the docs from any given repository has several key benefits:

Code snippets in the documentation are guaranteed to work as they are continuously tested. This also means that they can be reliably copied and pasted into the user's editor.
We control exactly which lines of code are shown and can also target a specific branch or commit. This is a great safeguard against bugs which might be introduced to the main branch.
We never have to commit source code into the docs. The code is merged into the Markdown at build time. This ensures that the code is already reviewed and approved from the repo it resides in.

Snipsync does come with a few considerations:

Embedded code needs to have carefully reviewed comments, structure, and make sense within the context of the documentation. For example, if the code snippet is coming from a working repo it may include additional variables or function calls. These must be minimized and optimized out so they don’t cause unnecessary confusion.
In the same way that the code must be optimized for the docs, the docs must also be optimized for the code. In essence, the docs are being “driven” and "defined" by the underlying code. And if no one has coined the term yet, I think the credit for “code-driven documentation” should go to our Head of Product, Ryland Goldstein, as he pinged me one afternoon to share that epiphany with me.

We decided to embrace Snipsync as the challenges it introduced were minimal compared to the value.

Snipsync on npm

Template repos

We now had a way to synchronize code with our documentation. But from where will the code be synchronized? We know users will likely want to view the source file and relative file path of the code snippet for added context. They will also be likely to clone the repo and try to run the sample.

We actually already had repositories of code samples for the Go SDK and Java SDK. While we desired to see more samples, there were already quite a few of them in each repository. But, we discovered that shared sample repositories tend to have two issues that made them less ideal for synchronizing with docs.

While convenient, colocating multiple samples in a single repo is far less approachable compared with storing samples in self-contained repos.
In shared sample repositories, it is harder to retain the idiomatic nature of any language and mirror the functionality of any sample across different languages.

So for each of the sample applications we planned on using to drive our documentation, we created a corresponding template repo. These template repos can be easily copied, built, and run in a matter of minutes.

The tutorial

Since the goal of our documentation changes was to help with new user acquisition, we decided to aim for a "tutorial" style of documentation. The first iterations aimed to build upon and replace the existing SDK “quick start” pages that maintained the status quo and printed “Hello World!” to the console. As you may have guessed, this route wasn’t sufficient enough to show users the real value Temporal offers.

Once it became clear that a standard approach wasn't going to cut it, we brought in our co-founder and CEO, Maxim Fateev. We asked him to give us a demonstration that he typically uses to introduce engineers to Temporal for the first time. The scenario represents a money transfer from one bank account to another and during the demo Maxim demonstrates what happens if one of the steps in the transfer fails. The money transfer sample was a great way to introduce the values of Temporal. For if you understand the ramifications of losing money from a failed financial transaction, several values of Temporal become immediately apparent:

The state of running code is maintained even through hardware failures, server crashes, and network outages.
There is deep visibility into the state of code execution out of the box via the CLI or UI.
Function calls come with automatic and retries and configurable timeouts.
Bugs can be hot fixed in running code.

For someone that is new to Temporal the attraction doesn’t come from using the SDK to print “Hello World!”. Instead it comes from witnessing the inherent benefits that Temporal offers by running simulations using a pre-built application.

This is the direction that we decided to send new users. If a user can wrap their heads around the value that Temporal brings to their application right out of the box, then spending time and energy on application setup and learning the SDK becomes a non-blocker.

Check out these finished tutorials and see for yourself!

Next steps

At Temporal we understand that our documentation plays a very important role in our users' experience. And to get our docs into a world class state we have lots of work in front of us. In the near future we will be looking at the end-to-end journey through our documentation and how we can provide the best experience for every user. To validate any direction we take, we will be engaging with the community to hear what you think and help us dial things in. Any user can schedule a 15 minute feedback session with me directly! We will also be preparing for all the new and exciting features around our hosted cloud offering that will enable all developers to build invincible applications.