DEV Community: Luiz Fernando Reis Cendretti

[Boost]

Luiz Fernando Reis Cendretti — Tue, 01 Apr 2025 11:14:28 +0000

Luiz Fernando Reis Cendretti

Apr 1 '25

Setting Up a Go Application with Kafka in a DevContainer

#go #docker #vscode #programming

Comments

3 min read

Setting Up a Go Application with Kafka in a DevContainer

Luiz Fernando Reis Cendretti — Tue, 01 Apr 2025 11:13:58 +0000

The Pain of Setting Up Development Environments

How much time have you lost configuring your environment to run multiple applications at the same time? Maybe an hour? Or even a whole month? Then, after coding for weeks, your computer crashes, and the only solution is a hard reset. Now, you find yourself in the same situation, rebuilding everything from scratch. A personal nightmare, right? 😅

Fortunately, VSCode offers a solution: running your application inside a Docker container. With this approach, the only setup you need is Docker. Like magic! ✨

What is a DevContainer?

The DevContainer feature in VSCode allows developers to configure their application environment once and run it anywhere. In this article, I'll show you how to build a Go application with Kafka using a DevContainer.

Why Go and Kafka?

Go and Kafka make a powerful combination for building high-performance microservices. Kafka allows you to distribute workloads using partitions, while Go's lightweight goroutines help maximize performance. Imagine allocating threads based on Kafka partitions—Kafka efficiently manages message distribution while Go ensures optimal processing.

🚀 Let's Get Started

1️⃣ Initialize Your Go Project

First, create a project folder and initialize a Go module:

mkdir go-with-kafka
cd go-with-kafka && go mod init go-with-kafka

2️⃣ Set Up a DevContainer

Open your project in VSCode and create a .devcontainer folder. This will contain all the Docker configurations needed for development.

Create `boot.sh`

This script initializes the environment and sets up a Kafka topic:

#!/bin/zsh

# Update package list
sudo apt update

# Install Go dependencies
go mod tidy

# Change ownership of Go directories to vscode user
sudo chown -R vscode:vscode .

# Creating a Kafka topic
echo "Waiting for Kafka to start..."
sleep 10

kafka-topics --create \
  --bootstrap-server kafka:29092 \
  --replication-factor 1 \
  --partitions 1 \
  --topic example-topic || echo "The topic already exists."

echo "Topic created."

Create `docker-compose.yml`

This file defines services for your Go application, Kafka, and Zookeeper:

version: '3'
services:
  app:
    build:
      context: ..
      dockerfile: .devcontainer/Dockerfile
    environment:
      - VISUAL="code --wait"
      - APPNAME=go-with-kafka
    volumes:
      - ../..:/workspaces:cached
      - ~/.ssl:/home/vscode/.ssl:ro
    command: sleep infinity

  zookeeper:
    image: confluentinc/cp-zookeeper:latest
    environment:
      ZOOKEEPER_CLIENT_PORT: 2181
      ZOOKEEPER_TICK_TIME: 2000

  kafka:
    image: confluentinc/cp-kafka:latest
    depends_on:
      - zookeeper
    ports:
      - "9092:9092"
    environment:
      KAFKA_BROKER_ID: 1
      KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181
      KAFKA_ADVERTISED_LISTENERS: INSIDE://kafka:29092,OUTSIDE://localhost:9092
      KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: INSIDE:PLAINTEXT,OUTSIDE:PLAINTEXT
      KAFKA_INTER_BROKER_LISTENER_NAME: INSIDE
      KAFKA_AUTO_CREATE_TOPICS_ENABLE: true

Create `Dockerfile`

FROM mcr.microsoft.com/devcontainers/go

# [Optional] Uncomment this section to install additional OS packages.
RUN apt-get update && export DEBIAN_FRONTEND=noninteractive \
    && apt-get -y install --no-install-recommends

🏗️ Building a Simple Kafka Pub/Sub in Go

Create `main.go`

package main

import (
    "context"
    "log"
    "os"

    "github.com/segmentio/kafka-go"
)

func main() {
    if len(os.Args) < 2 {
        log.Fatalf("Usage: %s [pub|sub]", os.Args[0])
    }

    mode := os.Args[1]
    brokers := []string{"kafka:29092"}
    topic := "example-topic"

    switch mode {
    case "pub":
        publish(brokers[0], topic)
    case "sub":
        subscribe(brokers[0], topic)
    default:
        log.Fatalf("Invalid mode: %s. Use 'pub' to publish or 'sub' to consume.", mode)
    }
}

func publish(broker string, topic string) {
    writer := kafka.Writer{
        Addr:     kafka.TCP(broker),
        Topic:    topic,
        Balancer: &kafka.LeastBytes{},
    }

defer writer.Close()

    message := kafka.Message{
        Key:   []byte("Key"),
        Value: []byte("Hello, Kafka with kafka-go!"),
    }

    err := writer.WriteMessages(context.Background(), message)
    if err != nil {
        log.Fatalf("Error sending message: %v", err)
    }

    log.Println("Message sent successfully!")
}

func subscribe(broker string, topic string) {
    reader := kafka.NewReader(kafka.ReaderConfig{
        Brokers:   []string{broker},
        Topic:     topic,
        Partition: 0,
        MinBytes:  10e3, // 10KB
        MaxBytes:  10e6, // 10MB
    })

defer reader.Close()

    log.Println("Waiting for messages...")

    for {
        message, err := reader.ReadMessage(context.Background())
        if err != nil {
            log.Fatalf("Error reading message: %v", err)
        }
        log.Printf("Message received: key=%s value=%s\n", string(message.Key), string(message.Value))
    }
}

🎯 Running the Application

In VSCode, press Ctrl + Shift + P (or Cmd + Shift + P on macOS) and select Rebuild and Reopen in Container. Wait for the setup to complete. Once inside the container, open a terminal and run:

Start the subscriber:

go run main.go sub

Publish a message:

go run main.go pub

If everything works, you now have a Kafka-based Go application running inside a DevContainer! 🎉

🌟 Why Use DevContainers?

DevContainers are powerful for developers who don’t want to waste time configuring their local machine. Using containers ensures that your setup is portable and consistent across different environments.

🔗 Check out more DevContainer templates: GitHub - devcontainers/templates

A Minimalist VSCode to Help You Focus on Coding

Luiz Fernando Reis Cendretti — Wed, 12 Mar 2025 10:51:35 +0000

Maybe you are tired of your VSCode layout, but I have a solution! This setup follows a minimalist approach, removing all unnecessary elements from your screen so you can focus entirely on your code.

I got this idea from Rocketseat’s CTO, and after applying it, I noticed a real improvement in my productivity.

Let's Customize Your VSCode!

To achieve this clean and focused look, you should install the following extensions:

Fonts

For fonts, I’m using JetBrains Mono. It's an unusual choice, but you can use any font you like—Fira Code, for example. I prefer JetBrains Mono because it supports font ligatures, which enhance readability.

Configuration

After installing the extensions, open your settings.json and paste the following configuration:

{
    "workbench.startupEditor": "newUntitledFile",
    "workbench.editor.doubleClickTabToToggleEditorGroupSizes": "maximize",
    "editor.fontSize": 14,
    "editor.lineHeight": 1.8,
    "editor.rulers": [80, 120],
    "extensions.ignoreRecommendations": true,
    "files.associations": {
      ".env.*": "dotenv",
      ".prettierrc": "json",
      "*.css": "css"
    },
    "symbols.files.associations": {
      ".env.example": "gear"
    },
    "editor.parameterHints.enabled": false,
    "editor.renderLineHighlight": "gutter",
    "editor.suggestSelection": "first",
    "explorer.confirmDelete": false,
    "terminal.integrated.showExitAlert": false,
    "workbench.editor.labelFormat": "short",
    "editor.fontLigatures": true,
    "editor.acceptSuggestionOnCommitCharacter": false,
    "explorer.compactFolders": false,
    "git.enableSmartCommit": true,
    "editor.accessibilitySupport": "off",
    "explorer.confirmDragAndDrop": false,
    "editor.codeActionsOnSave": {
      "source.fixAll.eslint": "explicit"
    },
    "editor.semanticHighlighting.enabled": false,
    "breadcrumbs.enabled": false,
    "workbench.productIconTheme": "fluent-icons",
    "editor.fontFamily": "JetBrains Mono",
    "editor.tabSize": 2,
    "security.workspace.trust.untrustedFiles": "newWindow",
    "files.exclude": {
      "**\/CVS": true,
      "**\/.DS_Store": true,
      "**\/.hg": true,
      "**\/.svn": true,
      "**\/.git": true,
      ".vscode": true
    },
    "workbench.iconTheme": "symbols",
    "update.mode": "start",
    "[jsonc]": {
      "editor.defaultFormatter": "vscode.json-language-features"
    },
    "[json]": {
      "editor.defaultFormatter": "vscode.json-language-features"
    },
    "window.commandCenter": true,
    "git.openRepositoryInParentFolders": "always",
    "symbols.hidesExplorerArrows": false,
    "workbench.editor.empty.hint": "hidden",
    "update.showReleaseNotes": false,
    "security.promptForLocalFileProtocolHandling": false,
    "workbench.activityBar.location": "hidden",
    "apc.activityBar": {
      "position": "bottom",
      "hideSettings": true,
      "size": 48,
      "itemMargin": 8,
      "itemSize": 32
    },
    "editor.hideCursorInOverviewRuler": true,
    "editor.minimap.enabled": false,
    "window.titleBarStyle": "native",
    "apc.electron": {
      "titleBarStyle": "hiddenInset",
      "trafficLightPosition": {
        "x": 11,
        "y": 10
      },
      "frame": false
    },
    "apc.header": {
      "height": 36
    },
    "apc.listRow": {
      "height": 24
    },
    "apc.font.family": "'Inter'",
    "apc.stylesheet": {
      ".title-label > h2": "display: none",
      ".editor-actions": "display: none",
      ".nosidebar .inline-tabs-placeholder": "width: 75px",
      ".pane-header": "padding: 0 8px",
      ".pane-body": "padding: 8px",
      ".split-view-view:first-child .pane-header": "display: none !important;",
      ".monaco-list-row": "border-radius: 4px;",
      ".monaco-workbench .monaco-list:not(.element-focused):focus:before": "display: none;"
    },
    "editor.scrollbar.vertical": "hidden",
    "explorer.sortOrder": "foldersNestsFiles",
    "explorer.fileNesting.patterns": {
      ".env.local": ".env*",
      ".env": ".env*"
    },
    "explorer.fileNesting.enabled": true,
    "workbench.colorTheme": "Min Dark",
    "workbench.statusBar.visible": false,
    "window.customTitleBarVisibility": "never",
    "diffEditor.ignoreTrimWhitespace": false,
    "diffEditor.maxComputationTime": 0,
    "remote.autoForwardPortsSource": "hybrid"
  }

After applying these settings, your VSCode should look like this:

I really love this setup because it helps me focus on coding, and, to be honest, it looks beautiful!

Quick Tip

To access the sidebar menu, use CTRL + Q.

Reference

Check out the original inspiration for this setup in this video.

Hope you enjoyed this article! See you in the next one. 🚀

DEV Community: Luiz Fernando Reis Cendretti

[Boost]

Setting Up a Go Application with Kafka in a DevContainer

Setting Up a Go Application with Kafka in a DevContainer

The Pain of Setting Up Development Environments

What is a DevContainer?

Why Go and Kafka?

🚀 Let's Get Started

1️⃣ Initialize Your Go Project

2️⃣ Set Up a DevContainer

Create boot.sh

Create docker-compose.yml

Create Dockerfile

🏗️ Building a Simple Kafka Pub/Sub in Go

Create main.go

🎯 Running the Application

🌟 Why Use DevContainers?

A Minimalist VSCode to Help You Focus on Coding

Let's Customize Your VSCode!

Fonts

Configuration

Quick Tip

Reference

Create `boot.sh`

Create `docker-compose.yml`

Create `Dockerfile`

Create `main.go`