DEV Community: Sebastian Fritsch

Top 10 Exciting Tools for DevOps in 2024

Sebastian Fritsch — Fri, 17 May 2024 10:46:40 +0000

Exploring Docker and Kubernetes has been a fascinating journey. We've uncovered tools that boost performance, elevate experiences, and turn mundane tasks into thrilling adventures. Let's get started with the top ten exciting tools for DevOps in 2024! 🚀

1. Dagger.io

From the early days, I’ve been closely following the Dagger project with great enthusiasm. It promised to elevate Docker to new heights, addressing the notorious “It works on my machine” dilemma and enabling developers to construct pipelines locally. Initially, Dagger utilized CUE for communication with its engine. Now, the platform has evolved to support a variety of languages like GO, NodeJS, and Python, allowing for the creation of comprehensive CI/CD pipelines that operate consistently both locally and in the cloud. Additionally, Dagger has introduced modules, akin to functions, that you can incorporate into your pipeline. These can be stored on GitHub in what is known as the Daggerverse. Moreover, these modules can be executed independently using the dagger call command, enhancing modularity and reusability.

Website: Dagger.io
Documentation: Dagger Docs
Deep Dive: Argo Workflows with Dagger

2. Nix

The tool that excites me the most on this list is Nix! It holds the second top position because it is not yet fully optimized for efficient use in CI pipelines. Nix is a unique package manager designed for Unix systems, utilizing its own language, Nix, to define and manage software with guaranteed reproducibility and allows you to specify exact versions for dependencies through Nix flakes. I envision the ability to execute a comprehensive pipeline in Nix, breaking it down into various phases, which can be independently run using the command nix develop --command. This method allows you to execute your pipelines both locally and on the Cloud, similar to Dagger, without relying on Docker! However, it has not achieved this level of functionality yet. The Dagger Team places emphasis on performance and boasts a much gentler learning curve as it does not necessitate learning a new language.

Documentation: Nix
Deep Dive:
nix3
nix develop
Nix for CI:
Garnix
Hercules CI
NixOS Hydra

3. Devbox

Devbox is an abstraction on top of Nix that simplifies the process of setting up development environments. It’s tailored specifically for this use case and aims to be much more user-friendly. With Devbox, you can define your development environment with a simple JSON config file, without the need to become a Nix expert. I attempted to utilize NixOS within a Docker container to establish an interactive development environment and manage my dependencies using Nix. However, I found that using Devbox streamlined the process significantly, as it allowed me to effortlessly create a Dockerfile using the command devbox generate dockerfile

Website: devbox
Documentation: devbox docu
Deep Dive: generate dockerfile

4. KCL

Actually I wanted to add timoni in the list which is a package manager for Kubernetes powered by CUE but I guess KCL will win the race of a better Helm idea.
KCL (Kubernetes Configuration Language) is an open-source, constraint-based record and functional programming language designed to manage Kubernetes configurations . It aims to improve modularity, scalability, and stability around configuration management. KCL provides several benefits over traditional tools like Helm.
In comparison to Helm, which is an imperative templating tool that manages Kubernetes packages called charts, KCL allows direct writing of configurations in code, thus eliminating the need to read and edit basic YAML files.
Overall, KCL can replace Helm by providing a more robust and error-resistant way to manage Kubernetes configurations, with the added benefits of code reusability and better validation mechanisms.

Website: KCL Lang
Documentation: KCL Docs
Deep Dive: Generate Manifests
Helm KCL Plugin

5. Lens

Kubernetes, while powerful, can present a steep learning curve due to its complexity and the multitude of kubectl commands required for effective operation. For those who appreciate simplicity and efficiency, Lens IDE emerges as a highly recommended solution. As an integrated development environment tailored for Kubernetes, Lens IDE offers a user-friendly interface that streamlines the management of components, events, and monitoring. It simplifies the editing of configurations, making it accessible even for those less familiar with Kubernetes intricacies.

One of the standout features of Lens IDE is its capability to manage multiple clusters with ease. By simply adding your kubeconfig file, Lens IDE allows you to switch between different clusters seamlessly. This feature is particularly beneficial for developers and system administrators who need to interact with various Kubernetes environments.
Lens IDE is not just a tool; it’s a strategic investment in your Kubernetes journey. It transforms Kubernetes complexity into clarity, empowering teams to focus on what matters most—building value.

Website: Download now and thank me later!

6. Arkade

Arkade is an open-source marketplace for Kubernetes apps, tools, and CLIs, designed to simplify the process of installing development tools and Kubernetes applications. It provides a streamlined command-line interface (CLI) that allows developers to quickly install their favorite CLI tools and Kubernetes apps without the need to manually search for and manage Helm charts.
Whenever I’m setting up Kubernetes applications such as cert-manager and nginx-controller on a new cluster, I prefer the convenience of Arkade for a hassle-free installation. With just a couple of commands, I can get these apps up and running:



arkade install ingress-nginx
arkade install cert-manager

Arkade streamlines the process, transforming what could be a complex task into a simple and efficient one.

Documentation: Arkade Docs
Deep Dive: Blog

7. Infisical

Infisical is a secret management platform designed for Kubernetes, which serves as a secure repository for sensitive data like API keys, certificates, and passwords. It’s particularly useful in Kubernetes environments where managing and injecting secrets into applications can be complex and security-critical.

The Infisical Secrets Operator is a Kubernetes controller that retrieves secrets from Infisical and stores them in a designated cluster. It uses an InfisicalSecret resource to specify authentication and storage methods, and it can automatically update secrets and reload dependent deployments.
Additionally, Infisical boasts a user-friendly WebUI built with Next.js, which simplifies the management of secrets across different environments and projects. This WebUI allows users to interact with the Infisical platform visually, making it easier to manage secrets without delving into command-line operations.

Website: Infisical
Documentation: Infisical Docs

8. Crossplane

Crossplane is an open-source Kubernetes add-on that extends the capabilities of Kubernetes to manage and compose infrastructure, services, and applications from multiple cloud providers. It allows you to define your infrastructure directly within Kubernetes using a declarative YAML syntax, treating cloud resources as first-class citizens in Kubernetes.

The key feature of Kubernetes that Crossplane utilizes is the control loop, which operates on the principles of observe, differentiate, and act. This means Crossplane continuously monitors the state of the infrastructure, compares it with the desired state defined in the code, and takes necessary actions to align the two. This approach ensures that any drifts in the infrastructure are automatically corrected, maintaining the desired state as defined by the user.

Website: Crossplane
Documentation: Crossplane Docs

9. Chainguard

Chainguard is a company dedicated to enhancing software supply chain security. It specializes in ensuring Kubernetes clusters deploy only trusted container images. Their product, Chainguard Images, offers minimal and hardened container images with no known vulnerabilities. The use of such minimal base images, akin to Alpine Linux, is crucial due to their smaller size and reduced potential for security risks.

Chainguard provides tools like wolfi-base to help developers build secure Docker images with minimal base images, offering a hardened alternative to traditional options like Alpine Linux. This approach is crucial for maintaining security and efficiency in containerized environments.

Website: Chainguard
Image Gallery: Chainguard Images
Deep Dive: Wolfi Image
Distroless Images

10. Amazon Q Developer

Amazon Q Developer is an AI-powered assistant for software development provided by AWS. It offers a range of features to enhance the coding experience, including real-time code suggestions, assistance with complex tasks through autonomous agents, and the ability to modernize legacy code. It’s designed to be integrated into various IDEs, including Visual Studio Code, making it accessible right within your coding environment.
Compared to GitHub Copilot, which was initially trained on data up until September 2021, Amazon Q Developer might have an advantage in terms of having access to more recent data and AWS-specific knowledge. However, it’s important to note that GitHub Copilot has been updated since then. As of November 30, 2023, GitHub Copilot Chat is powered by GPT-4, and it introduced new features like code referencing in VS Code and the concept of “agents” to assist with specific tasks.
Both tools are designed to work within VSCode, providing inline code suggestions and other productivity-boosting capabilities. The choice between the two may come down to specific needs, such as preference for AWS integration with Amazon Q Developer or the broader coding support offered by GitHub Copilot.

IDE-Style Command Line Intellisense: Amazon Q CMD Line
Website: Amazon Q Developer
Deep Dive: Youtube Video

SurrealDB: Version 1.0 Just Released! Next Gen SQL Database?

Sebastian Fritsch — Wed, 07 Feb 2024 08:40:04 +0000

SurrealDB: Version 1.0 Just Released! Next Gen SQL Database?

Introducing the Future of Database Management: Version 1.0 Just Released! 🚀 Is this the Next Gen SQL Database You've Been Waiting For? 🌟

Explaining why SurrealDB through historical context

First, let's delve into why SurrealDB stands out in contrast to widely-used databases.

From physical paper to digital paper

Relational (Table): SQL
Document: NoSQL
Graph

Relational databases 📊

SQL is like a puzzle. You plan, create, and assemble pieces to get your answer, often requiring multiple pieces for each solution.

price_list

id	price
1	1.7
2	1.5
3	22.99

fruit_box

id	fruit	quantity
1	Apple	5
2	Orange	3
3	Durian	1000

select * from fruit_box

select fruit from fruit_box

select fruit, price from fruit_box fb

inner join price_list pl on fb.id=pl.id

The first query retrieves all data from the fruit_box table.
The second query retrieves only the fruit column from the fruit_box table.
The third query combines data from both the fruit_box _and price_list_ tables, showing the fruit names and their associated prices where there is a matching id in both tables.

SQL is like a puzzle. You plan, create, and assemble pieces to get your answer, often requiring multiple pieces for each solution.

Document 📄

I prefer a straightforward approach. Instead of solving a puzzle each time, I'd rather create a comprehensive document with all the needed information. Then, I can simply read that document to find the answers I seek.

db={
    "fruit_box": [
        {
            "_id": 1,
            "fruit": "Apple",
            "quantity": 5
        },
        {
            "_id": 2,
            "fruit": "Orange",
            "quantity": 3
        },
        {
            "_id": 3,
            "fruit": "Durian",
            "quantity": 1000
        },
    ]
}

"price_list": [
    {
        "_id": 1,
        "price": 1.7,
    },
    {
        "_id": 2,
        "price": 1.5,
    },
    {
        "_id": 3,
        "price": 22.99,
    },
]

db.fruit_box.find()

db.fruit_box.find({}, {fruit: 1, _id: 0})

db.fruit_box.aggregate([{
    "$lookup": {
        "from": "price_list",
        "localField": "_id",
        "foreignField": "_id",
        "as": "Result"
    }
}])

Graph 🕸️

Similar to a social network, you map out who knows what and how they're connected. Then, you navigate through the network, asking until you find what you need.

(1:fruit_box {fruit:"Apple",quantity:5})

(2:fruit_box {fruit:"Orange",quantity:3})

(3:fruit_box {fruit:"Durian",quantity:1000})

(1:price_list {price:1.7})

(2:price_list {price:1.5})

(3:price_list {price:22.99})

match (f:fruit_box)

return f

match (f:fruit_box)

return f.fruit

match (f:fruit_box)-[:lookup]->(p:price_list)

return f.fruit, p.price

NewSQL - SurrealQL

select fruit,

->lookup->price_list.price as price

from fruit_box

SurrealQL simplifies the complexity, particularly regarding table relationships. Additionally, if you insert data into a non-existent table, SurrealDB will generate the table automatically.

Nice Features and small size

SurrealDB offers a wealth of features, and its version 1.0.0 Docker image is exceptionally compact at just 17.5 MB, thanks to its Rust-based architecture. In comparison, Postgresql's image size exceeds 80 MB.

When using SurrealDB within a web browser, the WebAssembly library provides support for connecting to a remote database via HTTP or WebSockets. It also allows for data persistence using IndexedDB in the browser. You have the flexibility to choose between a schemafull or schemaless approach. You can store unstructured nested data with any columns or selectively limit data storage to specific columns or fields. This means you can start quickly without the need to define every column and transition to a schema-full approach once your data model is established.

Oh and did I mention in SurrealQL, comments can be written in a number of different ways.

/* In SurrealQL, comments can be written as single-line or multi-line comments,

and comments can be used and interspersed within statements. */

SELECT  FROM / get all users */ user;

There are a number of ways to use single-line comments
SELECT * FROM user;

// Alternatively using two forward-slash characters

SELECT * FROM user;

-- Another way is to use two dash characters

SELECT * FROM user;

SurrealDB: Version 1.0 🥇 Just Released! Next Gen SQL Database?

Sebastian Fritsch — Thu, 28 Sep 2023 16:02:03 +0000

SurrealDB: Version 1.0 Just Released! Next Gen SQL Database?

Introducing the Future of Database Management: Version 1.0 Just Released! 🚀 Is this the Next Gen SQL Database You've Been Waiting For? 🌟

Explaining why SurrealDB through historical context

First, let's delve into why SurrealDB stands out in contrast to widely-used databases.

From physical paper to digital paper

Relational (Table): SQL
Document: NoSQL
Graph

Relational databases 📊

SQL is like a puzzle. You plan, create, and assemble pieces to get your answer, often requiring multiple pieces for each solution.

price_list

id	price
1	1.7
2	1.5
3	22.99

fruit_box

id	fruit	quantity
1	Apple	5
2	Orange	3
3	Durian	1000

select * from fruit_box
select fruit from fruit_box

select fruit, price from fruit_box fb
inner join price_list pl on fb.id=pl.id

The first query retrieves all data from the fruit_box table.
The second query retrieves only the fruit column from the fruit_box table.
The third query combines data from both the fruit_box and price_list tables, showing the fruit names and their associated prices where there is a matching id in both tables.

SQL is like a puzzle. You plan, create, and assemble pieces to get your answer, often requiring multiple pieces for each solution.

Document 📄

db={
    "fruit_box": [
        {
            "_id": 1,
            "fruit": "Apple",
            "quantity": 5
        },
        {
            "_id": 2,
            "fruit": "Orange",
            "quantity": 3
        },
        {
            "_id": 3,
            "fruit": "Durian",
            "quantity": 1000
        },
    ]
}

"price_list": [
    {
        "_id": 1,
        "price": 1.7,
    },
    {
        "_id": 2,
        "price": 1.5,
    },
    {
        "_id": 3,
        "price": 22.99,
    },
]

db.fruit_box.find()

db.fruit_box.find({}, {fruit: 1, _id: 0})
db.fruit_box.aggregate([{
    "$lookup": {
        "from": "price_list",
        "localField": "_id",
        "foreignField": "_id",
        "as": "Result"
    }
}])

Graph 🕸️

Similar to a social network, you map out who knows what and how they're connected. Then, you navigate through the network, asking until you find what you need.

(1:fruit_box {fruit:"Apple",quantity:5})
(2:fruit_box {fruit:"Orange",quantity:3})
(3:fruit_box {fruit:"Durian",quantity:1000})

(1:price_list {price:1.7})
(2:price_list {price:1.5})
(3:price_list {price:22.99})

match (f:fruit_box)
return f

match (f:fruit_box)
return f.fruit

match (f:fruit_box)-[:lookup]->(p:price_list)
return f.fruit, p.price

NewSQL - SurrealQL

select fruit,
->lookup->price_list.price as price
from fruit_box

SurrealQL simplifies the complexity, particularly regarding table relationships. Additionally, if you insert data into a non-existent table, SurrealDB will generate the table automatically.

Nice Features and small size

Oh and did I mention in SurrealQL, comments can be written in a number of different ways.

/* In SurrealQL, comments can be written as single-line or multi-line comments,
and comments can be used and interspersed within statements. */

SELECT * FROM /* get all users */ user;

# There are a number of ways to use single-line comments
SELECT * FROM user;

// Alternatively using two forward-slash characters
SELECT * FROM user;

-- Another way is to use two dash characters
SELECT * FROM user;

Watch SurrealDB Keynote

VSCode on iPad Pro with code-server self-hosted

Sebastian Fritsch — Wed, 28 Jun 2023 18:04:50 +0000

Last year I posted about using VSCode on iPad Pro you can check it out here: VSCode on iPad Pro

Today I want to show you a new way to self-host VSCode and use it anywhere which can open a browser.

Look at this VSCode on an iPhone:

How to use code-server on an iPad Pro

Code-server is a web-based version of Visual Studio Code that allows you to code from anywhere, using any device. It runs on a remote server and lets you access your code and files through a browser. In this article, we will show you how to use code-server on an iPad Pro, using coder.com as a reference.

What you need

To use code-server on an iPad Pro, you will need the following:

An iPad Pro with iOS 14 or later
A code-server account or a self-hosted server
A domain name and a SSL certificate (optional but recommended)
A keyboard and a mouse (optional but recommended)

Installing the code-server progressive web app (PWA)

The easiest way to use code-server on an iPad Pro is to install the code-server progressive web app (PWA). A PWA is a web app that behaves like a native app, with features such as offline access, full-screen mode, and keyboard shortcuts. To install the code-server PWA, follow these steps¹:

Open code-server in Safari.
Click the Share icon.
Click Add to Home Screen.
You can now open code-server from the Home screen, and when you do, you'll be using the PWA.

Accessing code-server using Servediter

If you don't have a domain name or a SSL certificate, or you are unable to get them working, you can use Servediter for code-server. Servediter is an app that allows you to access code-server from your iPad without any configuration. To use Servediter, follow these steps:

Download the app from the App Store.
When prompted, provide your server information.
If you are running a local server or a Raspberry Pi connected via USB-C, you will input your settings into Self Hosted Server.

Using code-server on an iPad Pro

Once you can access code-server on your iPad Pro, you can start coding as usual. You can use all the features of VS Code, such as extensions, themes, debugging, terminal, etc. You can also use multi-task mode to make code changes and see the browser at the same time. This prevents the iOS background from dropping an app's state if you are switching between code-server and browser (with both in full-screen).

You may also want to use a keyboard and a mouse for a better coding experience. You can connect them via Bluetooth or USB-C. You can also customize your keybindings in VS Code to suit your preferences.

Conclusion

Code-server is a great tool for coding on an iPad Pro. It gives you the power and flexibility of VS Code in a web browser. You can install the code-server PWA for a native-like experience, or use Servediter for a hassle-free access. You can also enhance your productivity with a keyboard and a mouse, and use multi-task mode to see your code and browser side by side with Stage Manager.

Installation

There are plenty of methods on how to install code-server on your self-hosted machine. I installed it on Kubernetes with the Helm chart explained here

Simple email service with GO: Why I stopped using node-mailer

Sebastian Fritsch — Sun, 26 Mar 2023 20:22:06 +0000

GO is surprisingly simple when it comes to micro services, not only is GO easy to learn, coding with GO is a lot of fun. It has a built-in formatter and can show you errors right away in the coding lines.

Now let's first see the difference of writing an email service between NodeJS and GO.

Example using node-mailer with NodeJS:

const nodemailer = require('nodemailer');

let transporter = nodemailer.createTransport({
    service: 'gmail',
    auth: {
        user: 'youremail@gmail.com',
        pass: 'yourpassword'
    }
});

let mailOptions = {
    from: 'youremail@gmail.com',
    to: 'recipient@example.com',
    subject: 'Node Mailer Test',
    text: 'Hello from Node Mailer!',
    html: '<h1>Hello from Node Mailer!</h1>'
};

transporter.sendMail(mailOptions, (error, info) => {
    if (error) {
        console.log(error);
    } else {
        console.log('Email sent: ' + info.response);
    }
});

same example using GO from core net package:

package main

import (
    "net/smtp"
)

func main() {
  // Set up authentication information.
  auth := smtp.PlainAuth("", "youremail@gmail.com", 
  "yourpassword", "smtp.gmail.com")

  // Connect to the server, authenticate, and send the email.
  err := smtp.SendMail("smtp.gmail.com:587", auth, 
  "youremail@gmail.com", []string{"recipient@example.com"}, 
  []byte("Subject: Email from Golang\n\nHello from Golang!"))
    if err != nil {
        panic(err)
    }
}

Of course they look similar and that doesn't change your mind to switch to a GO mail service except GO is cool!
So the real cool part comes into play when we use templates. With GO we can create .gohtml templates and change the message dynamically with the core html/template package.

Send your first email with go-simple-mail package:
I would suggest to use an app password for gmail authentication: Google app password

package main

import (
    "fmt"
    "github.com/xhit/go-simple-mail/v2"
    "html/template"
    "net/mail"
)

func main() {
    // Set up the email message.
    message := mail.NewMessage()
    message.SetHeader("From", "youremail@gmail.com")
    message.SetHeader("To", "recipient@example.com")
    message.SetHeader("Subject", "Email from Golang")

    // Parse the email body template and execute it with data.
    t, err := template.New("email").Parse(`<!doctype html>
<html lang="en">
    <head>
        <meta name="viewport" content="width=device-width" />
        <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
        <title></title>
    </head>

    <body>
    <div>with HTML</div>
        <p>{{.message}}</p>
    </body>
</html>`)
    if err != nil {
        fmt.Println(err)
        return
    }
    data := struct {
        Message string
    }{
        Message: "Hello from Golang!",
    }
    body := new(strings.Builder)
    err = t.ExecuteTemplate(body, "email", data)
    if err != nil {
        fmt.Println(err)
        return
    }
    message.SetBody("text/html", body.String())

    // Set up the SMTP server configuration.
    server := mail.NewSMTPClient()
    server.Host = "smtp.gmail.com"
    server.Port = 587
    server.Username = "youremail@gmail.com"
    server.Password = "yourpassword"
    server.Encryption = mail.EncryptionStartTLS

    // Send the email.
    err = server.Send(message)
    if err != nil {
        fmt.Println(err)
        return
    }
    fmt.Println("Email sent!")
}

checkout more here: GO-simple-mail

VSCode Server: Next level coding on iPad

Sebastian Fritsch — Wed, 21 Sep 2022 18:00:59 +0000

Two month ago I‘ve seen this video on Youtube which demonstrates the new VSCode Server where you can use VSCode anywhere with internet access on your iPad! Youtube

Since I‘ve got the iPad Pro M1 model, I was looking for a way to use VSCode on it. Apps like CodeSandbox, Py, Scriptable, Koder or the online VSCode feature github.dev inside your browser had already the idea of coding on your iPad. So you might ask then why should you use your iPad instead of your laptop or macbook?

Well, first of it is pretty cool to use the iPad as a coding machine! With the new features of iPadOS and the powerful Apple silicon M1 chip you definitely want to use your iPad like a desktop version. You can easily connect any bluetooth keyboard (I use the Logitech MX Keys for Mac) and bluetooth mouse (Like Logitech MX Anywhere 3) to your iPad plus you can use the touchscreen which the macbook does not have!

All these Apps I used before with my iPad have one common problem. You have no access to a terminal. Apple doesn’t let you to use your iPad as a desktop machine 👨‍💻 but still the community wants to use it like that. Big new changes will come in October with stage manager and full screen external monitor on iPadOS 16 🔥!

Let’s get to the meat 🥩 of this article! Microsoft describes VSCode Server the following way:

The VS Code Server is a private preview service you can run on a remote development machine, like your desktop PC or a virtual machine (VM). It allows you to securely connect to that remote machine from anywhere through a vscode.dev URL, without the requirement of SSH.

Literally you can run a pipeline between your desktop machine and your iPad to use all CLI tools and access to your complete folder structure on your iPad inside VSCode.

Here you can see I have access to my terminal with ZSH plus autocomplete plugin to run my GO programm.

It is still in preview but works like a charm and to get the full potential you need to download it as a web app to have full screen, better connection and no clipboard issues when pasting to the terminal.

To get started you need to sign up for it because VSCode Server is currently in preview.

VSCode Server Preview

code-server is the name of the CLI tool which you install on your coding machine. When you run the command you follow the instructions and connect with your Github account which is used for the secure tunnel connection to your browser. After that you can open vscode.dev and sign in with github again to run VSCode anywhere with internet access on your browser!

UPDATE

VSCode Server is now available for everyone and is called Remote-Tunnels!

You just click on Remote Tunnel access and login with your Github account and everything works the same as before.