Task Workers in Netflix Conductor - Orkes

dtnf45 — Tue, 01 Feb 2022 19:36:18 +0000

A worker is responsible for executing a task. Operator and System tasks are handled by the Conductor server, while user defined tasks needs to have a worker created that awaits the work to be scheduled by the server for it to be executed. Workers can be implemented in any language, and Conductor provides support for Java, Golang and Python worker framework that provides features such as polling threads, metrics and server communication that makes creating workers each.

Each worker embodies Microservice design pattern and follows certain basic principles:

Workers are stateless and do not implement a workflow specific logic.

Each worker executes a very specific task and produces well defined output given specific inputs.

Workers are meant to be idempotent (or should handle cases where the task that partially executed gets rescheduled due to timeouts etc.)

Workers do not implement the logic to handle retries etc, that is taken care by the Conductor server.

Implementing a Task Worker

To create a worker, implement the Worker interface.

public class SampleWorker implements Worker {

    private final String taskDefName;

    public SampleWorker(String taskDefName) {
        this.taskDefName = taskDefName;
    }

    @Override
    public String getTaskDefName() {
        return taskDefName;
    }

    @Override
    public TaskResult execute(Task task) {
        TaskResult result = new TaskResult(task);
        result.setStatus(Status.COMPLETED);

        //Register the output of the task
        result.getOutputData().put("outputKey1", "value");
        result.getOutputData().put("oddEven", 1);
        result.getOutputData().put("mod", 4);

        return result;
    }
}

More Details

https://orkes.io/content/docs/how-tos/task-configurations

Follow and star us on GitHub for updates
https://github.com/Netflix/conductor/

Join the Slack Community Channel at
https://join.slack.com/t/orkes-conductor/shared_invite/zt-xyxqyseb-YZ3hwwAgHJH97bsrYRnSZg

git fork vs git clone on a command line

dtnf45 — Fri, 17 Dec 2021 22:26:53 +0000

Whats the difference between a fork and a clone?

fork: you are creating a copy of the repository using your github id (if you are using github). If you create changes it the forked repository, you have to create a pull request to the original repository

technically fork is not a git command. So you will have to use something that is available on Github, GitLab etc..

If you are using Github. First install gh. Eg. on a mac

brew install gh

To login:

gh auth login --web

To fork a repo: E.g to fork Netflix Conductor repo

gh repo fork https://github.com/Netflix/conductor.git --clone

clone Cloning a repo will create a local copy on our computer so that it can sync between both the local and remote locations of the repo. Cloning is good when you want to get your own copy of a repository where you may not be contributing to the original project.

To clone:

git clone https://github.com/Netflix/conductor.git

DEV Community: dtnf45

Task Workers in Netflix Conductor - Orkes

Implementing a Task Worker

More Details

git fork vs git clone on a command line

Whats the difference between a fork and a clone?