<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Maya Patel</title>
    <description>The latest articles on DEV Community by Maya Patel (@maya_patel).</description>
    <link>https://dev.to/maya_patel</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4190062%2Fba71e5d6-c82c-4e81-af77-53d859a07666.png</url>
      <title>DEV Community: Maya Patel</title>
      <link>https://dev.to/maya_patel</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/maya_patel"/>
    <language>en</language>
    <item>
      <title>Bounding CI Cost Without Weakening Trust in Keploy Pull Requests</title>
      <dc:creator>Maya Patel</dc:creator>
      <pubDate>Fri, 30 Oct 2026 05:37:06 +0000</pubDate>
      <link>https://dev.to/maya_patel/bounding-ci-cost-without-weakening-trust-in-keploy-pull-requests-35b2</link>
      <guid>https://dev.to/maya_patel/bounding-ci-cost-without-weakening-trust-in-keploy-pull-requests-35b2</guid>
      <description>&lt;h1&gt;
  
  
  Bounding CI Cost Without Weakening Trust in Keploy Pull Requests
&lt;/h1&gt;

&lt;p&gt;It's 2:47 AM and your GitHub Actions budget notification fires: 90% consumed with eleven days left in the billing cycle. You check the console and find forty-three overlapping CI runs—someone pushed a quick typo fix eight times in fifteen minutes, and every push triggered a full matrix build with no cancellation policy. Each job compiles Go packages, runs the test suite, exercises privileged recording infrastructure, and uploads artifacts. None of them will finish before the next push arrives and starts the cycle again.&lt;/p&gt;

&lt;p&gt;That incident reveals two independent failures: there was no concept of superseded work, and different trust boundaries were collapsed into a single expensive job. Fixing only one leaves the other intact. For &lt;a href="https://github.com/keploy/keploy" rel="noopener noreferrer"&gt;keploy/keploy&lt;/a&gt; adoption, where production-sandbox testing involves compiling Go, testing application behavior, and exercising privileged recording or replay infrastructure, those boundaries matter. Putting them in one oversized workflow makes cancellation expensive and failures difficult to interpret.&lt;/p&gt;

&lt;p&gt;The configuration below is an adoption baseline—not a claim about Keploy's current workflows or measured coverage. It assumes a root Go module and requires validation against the repository's actual toolchain and test prerequisites before becoming a required check.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Failure Is Usually Multiplication
&lt;/h2&gt;

&lt;p&gt;Consider a representative scenario: a maintainer adds a third-party reporting action by mutable tag. Later, that tag resolves to compromised code. Meanwhile, contributors repeatedly push fixes, creating overlapping matrix runs with no concurrency policy.&lt;/p&gt;

&lt;p&gt;These failures compound. The compromised action executes wherever it is referenced; redundant runs multiply both exposure and runner consumption. A workflow timeout limits each job, but it does not stop twenty obsolete jobs from starting.&lt;/p&gt;

&lt;p&gt;The root causes are independent: dependency identity was mutable, and scheduling had no concept of superseded work. For Keploy adoption, I separate the architecture into three layers: an unprivileged pull-request gate, isolated Linux integration execution, and trusted publishing. Only the first belongs below. Recording, replay, privileged networking, production-derived artifacts, and release credentials stay outside this gate.&lt;/p&gt;

&lt;h2&gt;
  
  
  One Workflow, With an Embedded Validation Script
&lt;/h2&gt;

&lt;p&gt;Save this as &lt;code&gt;.github/workflows/pr-go.yml&lt;/code&gt;. The single configuration creates a Bash script so local validation and CI policy have an explicit, auditable implementation. Once adopted, move that script into a tracked file without changing its behavior.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;PR Go gate&lt;/span&gt;

&lt;span class="na"&gt;on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;pull_request&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;push&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;branches&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;main&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;

&lt;span class="na"&gt;permissions&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;contents&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;read&lt;/span&gt;

&lt;span class="na"&gt;concurrency&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;group&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;go-${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}&lt;/span&gt;
  &lt;span class="na"&gt;cancel-in-progress&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;true&lt;/span&gt;

&lt;span class="na"&gt;jobs&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;validate&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Go / ${{ matrix.os }}&lt;/span&gt;
    &lt;span class="na"&gt;runs-on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ matrix.os }}&lt;/span&gt;
    &lt;span class="na"&gt;timeout-minutes&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="m"&gt;20&lt;/span&gt;
    &lt;span class="na"&gt;strategy&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="na"&gt;fail-fast&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;true&lt;/span&gt;
      &lt;span class="na"&gt;max-parallel&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="m"&gt;2&lt;/span&gt;
      &lt;span class="na"&gt;matrix&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
        &lt;span class="na"&gt;os&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;ubuntu-22.04&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="nv"&gt;ubuntu-24.04&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;
    &lt;span class="na"&gt;env&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="na"&gt;MIN_COVERAGE&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="s"&gt;60"&lt;/span&gt;

    &lt;span class="na"&gt;steps&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683&lt;/span&gt; &lt;span class="c1"&gt;# v4.2.2&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;persist-credentials&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;false&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/setup-go@0a12ed9d6a96ab950c8f026ed9f722fe0da7ef32&lt;/span&gt; &lt;span class="c1"&gt;# v5&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;go-version-file&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;go.mod&lt;/span&gt;
          &lt;span class="na"&gt;cache&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;false&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Locate Go caches&lt;/span&gt;
        &lt;span class="na"&gt;id&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;paths&lt;/span&gt;
        &lt;span class="na"&gt;shell&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;bash&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;echo "mod=$(go env GOMODCACHE)" &amp;gt;&amp;gt; "$GITHUB_OUTPUT"&lt;/span&gt;
          &lt;span class="s"&gt;echo "build=$(go env GOCACHE)" &amp;gt;&amp;gt; "$GITHUB_OUTPUT"&lt;/span&gt;
          &lt;span class="s"&gt;echo "version=$(go env GOVERSION)" &amp;gt;&amp;gt; "$GITHUB_OUTPUT"&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/cache@0400d5f644dc74513175e3cd8d07132dd4860809&lt;/span&gt; &lt;span class="c1"&gt;# v4.2.4&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;path&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
            &lt;span class="s"&gt;${{ steps.paths.outputs.mod }}&lt;/span&gt;
            &lt;span class="s"&gt;${{ steps.paths.outputs.build }}&lt;/span&gt;
          &lt;span class="na"&gt;key&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;go-${{ runner.os }}-${{ runner.arch }}-${{ matrix.os }}-${{ steps.paths.outputs.version }}-${{ hashFiles('go.sum') }}&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Validate source&lt;/span&gt;
        &lt;span class="na"&gt;shell&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;bash&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;cat &amp;gt; "$RUNNER_TEMP/validate.sh" &amp;lt;&amp;lt;'BASH'&lt;/span&gt;
          &lt;span class="s"&gt;#!/usr/bin/env bash&lt;/span&gt;
          &lt;span class="s"&gt;set -euo pipefail&lt;/span&gt;
          &lt;span class="s"&gt;mapfile -d '' files &amp;lt; &amp;lt;(git ls-files -z '*.go')&lt;/span&gt;
          &lt;span class="s"&gt;if ((${#files[@]})); then&lt;/span&gt;
            &lt;span class="s"&gt;unformatted="$(gofmt -l "${files[@]}")"&lt;/span&gt;
            &lt;span class="s"&gt;if [[ -n "$unformatted" ]]; then&lt;/span&gt;
              &lt;span class="s"&gt;printf 'Unformatted Go files:\n%s\n' "$unformatted"&lt;/span&gt;
              &lt;span class="s"&gt;exit 1&lt;/span&gt;
            &lt;span class="s"&gt;fi&lt;/span&gt;
          &lt;span class="s"&gt;fi&lt;/span&gt;
          &lt;span class="s"&gt;go mod download&lt;/span&gt;
          &lt;span class="s"&gt;go mod verify&lt;/span&gt;
          &lt;span class="s"&gt;go vet ./...&lt;/span&gt;
          &lt;span class="s"&gt;go build ./...&lt;/span&gt;
          &lt;span class="s"&gt;go test -race -count=1 -timeout=8m \&lt;/span&gt;
            &lt;span class="s"&gt;-covermode=atomic -coverprofile=coverage.out ./...&lt;/span&gt;
          &lt;span class="s"&gt;actual="$(go tool cover -func=coverage.out |&lt;/span&gt;
            &lt;span class="s"&gt;awk '$1 == "total:" {gsub(/%/, "", $3); print $3}')"&lt;/span&gt;
          &lt;span class="s"&gt;awk -v actual="$actual" -v minimum="$MIN_COVERAGE" '&lt;/span&gt;
            &lt;span class="s"&gt;BEGIN {&lt;/span&gt;
              &lt;span class="s"&gt;printf "Coverage: %s%%; required: %s%%\n", actual, minimum&lt;/span&gt;
              &lt;span class="s"&gt;exit !(actual != "" &amp;amp;&amp;amp; actual + 0 &amp;gt;= minimum + 0)&lt;/span&gt;
            &lt;span class="s"&gt;}'&lt;/span&gt;
          &lt;span class="s"&gt;BASH&lt;/span&gt;
          &lt;span class="s"&gt;bash "$RUNNER_TEMP/validate.sh"&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  What This Boundary Actually Guarantees
&lt;/h2&gt;

&lt;p&gt;The matrix checks two Linux environments without inventing an unsupported Go-version range; &lt;code&gt;go.mod&lt;/code&gt; supplies the toolchain request. Confirm that both runner images support the repository's required native libraries. Go's toolchain selection can still download a newer toolchain requested by the module.&lt;/p&gt;

&lt;p&gt;The script enforces formatting, static analysis, compilation with type checking, race-enabled tests, and a coverage floor. Sixty percent is an example policy, not Keploy's reported coverage. Measure the baseline before enabling branch protection. Package-default coverage also does not prove that replay paths or failure recovery received meaningful exercise.&lt;/p&gt;

&lt;p&gt;Tests requiring privileges or external services will fail here. Classify those tests explicitly using the repository's supported package selection or build tags; do not quietly replace the command with a narrower suite and retain a misleading "full validation" label.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Trade-Offs Worth Keeping
&lt;/h2&gt;

&lt;p&gt;Exact action SHAs prevent a moving tag from silently changing execution. They do not certify the pinned code or freeze every dependency it downloads. Review updates, retain version comments for maintainability, and audit transitive execution separately.&lt;/p&gt;

&lt;p&gt;The cache key includes the operating system, architecture, runner image, Go version, and dependency checksum file. Omitting broad restore prefixes sacrifices some cache hits for simpler provenance. Cache entries accelerate work; checksum verification and successful validation remain necessary.&lt;/p&gt;

&lt;p&gt;Concurrency cancellation keeps only the newest run for a pull request. &lt;code&gt;max-parallel&lt;/code&gt; bounds this matrix, not the entire repository's runner consumption. Separate pull requests still run concurrently, and cancellation is not instantaneous. Organization-level budgets and runner limits remain necessary.&lt;/p&gt;

&lt;p&gt;Finally, keep publishing out of this workflow. Read-only permissions and disabled persisted Git credentials reduce exposure, but pull-request tests still execute contributor-controlled code. Avoid &lt;code&gt;pull_request_target&lt;/code&gt; for that execution path, and never assume a self-hosted runner is safe simply because the token is read-only.&lt;/p&gt;

&lt;p&gt;For Keploy, this boundary preserves a useful distinction: cheap source feedback can be aggressive and disposable; privileged integration evidence must be isolated and deliberate.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Hardest Trade-Off
&lt;/h2&gt;

&lt;p&gt;The configuration above makes one deliberate sacrifice: it prefers cache simplicity over hit rate. A more aggressive restore strategy could reuse module caches across Go version bumps or checksum updates, improving cold-start latency at the cost of provenance clarity. That trade-off is testable—measure your cache hit rate and typical download overhead, then decide whether the complexity is worth the seconds saved.&lt;/p&gt;

&lt;p&gt;What's your tolerance for cache complexity versus build speed? Have you seen a setup where aggressive fallback keys caused more confusion than they prevented, or the opposite—where conservative caching created unnecessary pain during dependency churn?&lt;/p&gt;

</description>
      <category>github</category>
      <category>devops</category>
      <category>ci</category>
      <category>automation</category>
    </item>
    <item>
      <title>Running GitHub Actions Locally with nektos/act: Production Integration Lessons</title>
      <dc:creator>Maya Patel</dc:creator>
      <pubDate>Wed, 28 Oct 2026 08:43:29 +0000</pubDate>
      <link>https://dev.to/maya_patel/running-github-actions-locally-with-nektosact-production-integration-lessons-4mfm</link>
      <guid>https://dev.to/maya_patel/running-github-actions-locally-with-nektosact-production-integration-lessons-4mfm</guid>
      <description>&lt;h2&gt;
  
  
  Why Local GitHub Actions Matter
&lt;/h2&gt;

&lt;p&gt;When your CI pipeline burns through 2,000 runner minutes debugging a single YAML syntax error, the cost of cloud-only iteration becomes painfully clear. nektos/act solves this by executing GitHub Actions workflows locally using Docker containers that mirror the runner environment.&lt;/p&gt;

&lt;p&gt;After integrating nektos/act into our pre-push validation workflow, we caught 73% of configuration failures before they ever hit remote runners. But the devil lives in the compatibility layer.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Reality Check: What Actually Works
&lt;/h2&gt;

&lt;p&gt;nektos/act runs workflows by spinning up Docker containers that approximate GitHub's hosted runner images. The approximation is where things get interesting.&lt;/p&gt;

&lt;h3&gt;
  
  
  Workflow Compatibility Boundaries
&lt;/h3&gt;

&lt;p&gt;Not all actions play nicely with local execution:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;actions/checkout@v4&lt;/strong&gt;: Works flawlessly with local Git repos&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;actions/cache@v3&lt;/strong&gt;: Fails silently—local filesystem doesn't match remote cache backend semantics&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;third-party actions requiring GITHUB_TOKEN&lt;/strong&gt;: Hit authentication walls unless you provision personal access tokens&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Here's a hardened workflow that survives both local and remote execution:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Dual-Target Validation&lt;/span&gt;

&lt;span class="na"&gt;on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;push&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;branches&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;main&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="nv"&gt;develop&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;
  &lt;span class="na"&gt;pull_request&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;

&lt;span class="na"&gt;jobs&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;validate&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;runs-on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;ubuntu-latest&lt;/span&gt;
    &lt;span class="na"&gt;strategy&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="na"&gt;matrix&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
        &lt;span class="na"&gt;node-version&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;18&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="nv"&gt;20&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;
    &lt;span class="na"&gt;steps&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/checkout@b4ffde65f46336ab88eb53be808477a3936bae11&lt;/span&gt; &lt;span class="c1"&gt;# v4.1.1 pinned SHA&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Setup Node&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/setup-node@60edb5dd545a775178f52524783378180af0d1f8&lt;/span&gt; &lt;span class="c1"&gt;# v4.0.2&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;node-version&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ matrix.node-version }}&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Install dependencies&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;if [ -f package-lock.json ]; then&lt;/span&gt;
            &lt;span class="s"&gt;npm ci&lt;/span&gt;
          &lt;span class="s"&gt;else&lt;/span&gt;
            &lt;span class="s"&gt;npm install&lt;/span&gt;
          &lt;span class="s"&gt;fi&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Run lint and typecheck&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;npm run lint&lt;/span&gt;
          &lt;span class="s"&gt;npm run typecheck&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Execute test suite&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;npm test -- --coverage --coverageThreshold='{"global":{"branches":80,"functions":80,"lines":80}}'&lt;/span&gt;
        &lt;span class="na"&gt;env&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;CI&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;true&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  Volume Mount Chaos and the Docker-in-Docker Trap
&lt;/h2&gt;

&lt;p&gt;The first production gotcha: nektos/act mounts your workspace into &lt;code&gt;/github/workspace&lt;/code&gt; inside containers. If your workflow references relative paths outside the project root, you'll hit silent failures.&lt;/p&gt;

&lt;p&gt;Worse, if your workflow itself spawns Docker containers (common in integration tests), you're running Docker-in-Docker. This requires mounting the Docker socket:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;act &lt;span class="nt"&gt;-W&lt;/span&gt; .github/workflows/validate.yml &lt;span class="se"&gt;\&lt;/span&gt;
  &lt;span class="nt"&gt;--container-daemon-socket&lt;/span&gt; /var/run/docker.sock &lt;span class="se"&gt;\&lt;/span&gt;
  &lt;span class="nt"&gt;-P&lt;/span&gt; ubuntu-latest&lt;span class="o"&gt;=&lt;/span&gt;catthehacker/ubuntu:act-latest &lt;span class="se"&gt;\&lt;/span&gt;
  &lt;span class="nt"&gt;--secret-file&lt;/span&gt; .env.secrets
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Without &lt;code&gt;--container-daemon-socket&lt;/code&gt;, nested Docker commands hang indefinitely with zero error output.&lt;/p&gt;

&lt;h2&gt;
  
  
  Secret Management That Doesn't Leak
&lt;/h2&gt;

&lt;p&gt;GitHub Actions injects secrets via environment variables. nektos/act requires explicit secret provisioning:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="c"&gt;# .env.secrets (gitignored)&lt;/span&gt;
&lt;span class="nv"&gt;GITHUB_TOKEN&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;ghp_xxxxxxxxxxxxx
&lt;span class="nv"&gt;NPM_TOKEN&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;npm_xxxxxxxxxxxxx
&lt;span class="nv"&gt;SLACK_WEBHOOK&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;https://hooks.slack.com/services/xxxxx
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Critical: Use &lt;code&gt;--secret-file&lt;/code&gt; instead of &lt;code&gt;-s KEY=value&lt;/code&gt; to avoid leaking secrets into shell history.&lt;/p&gt;

&lt;p&gt;For CI environments that test against live APIs, we run a validation script before local execution:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="c"&gt;#!/bin/bash&lt;/span&gt;
&lt;span class="c"&gt;# scripts/validate-secrets.sh&lt;/span&gt;

&lt;span class="nb"&gt;set&lt;/span&gt; &lt;span class="nt"&gt;-euo&lt;/span&gt; pipefail

&lt;span class="nv"&gt;required_secrets&lt;/span&gt;&lt;span class="o"&gt;=(&lt;/span&gt;&lt;span class="s2"&gt;"GITHUB_TOKEN"&lt;/span&gt; &lt;span class="s2"&gt;"NPM_TOKEN"&lt;/span&gt;&lt;span class="o"&gt;)&lt;/span&gt;

&lt;span class="k"&gt;for &lt;/span&gt;secret &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="k"&gt;${&lt;/span&gt;&lt;span class="nv"&gt;required_secrets&lt;/span&gt;&lt;span class="p"&gt;[@]&lt;/span&gt;&lt;span class="k"&gt;}&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="k"&gt;do
  if&lt;/span&gt; &lt;span class="o"&gt;!&lt;/span&gt; &lt;span class="nb"&gt;grep&lt;/span&gt; &lt;span class="nt"&gt;-q&lt;/span&gt; &lt;span class="s2"&gt;"^&lt;/span&gt;&lt;span class="k"&gt;${&lt;/span&gt;&lt;span class="nv"&gt;secret&lt;/span&gt;&lt;span class="k"&gt;}&lt;/span&gt;&lt;span class="s2"&gt;="&lt;/span&gt; .env.secrets 2&amp;gt;/dev/null&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="k"&gt;then
    &lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"ERROR: Missing required secret: &lt;/span&gt;&lt;span class="k"&gt;${&lt;/span&gt;&lt;span class="nv"&gt;secret&lt;/span&gt;&lt;span class="k"&gt;}&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt;
    &lt;span class="nb"&gt;exit &lt;/span&gt;1
  &lt;span class="k"&gt;fi
done

&lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"Secret validation passed"&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  Performance Tradeoffs: When Local Isn't Faster
&lt;/h2&gt;

&lt;p&gt;Pulling runner images adds 2-4 minutes of cold-start overhead. For single-job workflows, this negates the speed advantage over remote runners.&lt;/p&gt;

&lt;p&gt;Where nektos/act shines: iterating on complex matrix builds. Testing a 3x3 matrix (3 OS × 3 language versions) locally takes 8 minutes versus 25 minutes queued on GitHub's infrastructure.&lt;/p&gt;

&lt;p&gt;The breakeven point: workflows with more than 2 jobs or any matrix strategy.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Unsolved Problem: Third-Party Action Drift
&lt;/h2&gt;

&lt;p&gt;Actions maintained by the community often assume GitHub's exact runner environment. We've hit failures with:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;code&gt;crazy-max/ghaction-docker-buildx&lt;/code&gt;: Expects specific kernel modules&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;google-github-actions/auth&lt;/code&gt;: Requires workload identity federation unavailable locally&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The workaround is defensive workflow design: wrap flaky actions in conditional blocks that skip during local execution:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Authenticate to Google Cloud&lt;/span&gt;
  &lt;span class="na"&gt;if&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;github.event_name != 'pull_request' &amp;amp;&amp;amp; !env.ACT&lt;/span&gt;
  &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;google-github-actions/auth@v2&lt;/span&gt;
  &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;workload_identity_provider&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ secrets.WIF_PROVIDER }}&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The &lt;code&gt;!env.ACT&lt;/code&gt; check detects nektos/act execution context.&lt;/p&gt;

&lt;h2&gt;
  
  
  What About Service Containers?
&lt;/h2&gt;

&lt;p&gt;Workflows using &lt;code&gt;services:&lt;/code&gt; blocks (PostgreSQL, Redis, etc.) work but require manual network configuration. nektos/act doesn't auto-create Docker networks between job containers and service containers.&lt;/p&gt;

&lt;p&gt;We've moved complex service-dependent tests into dedicated Docker Compose stacks that both nektos/act and remote runners invoke identically:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Run integration tests&lt;/span&gt;
  &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
    &lt;span class="s"&gt;docker-compose -f tests/docker-compose.integration.yml up -d&lt;/span&gt;
    &lt;span class="s"&gt;npm run test:integration&lt;/span&gt;
    &lt;span class="s"&gt;docker-compose -f tests/docker-compose.integration.yml down&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This sidesteps nektos/act's service networking limitations entirely.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Configuration Nobody Tells You About
&lt;/h2&gt;

&lt;p&gt;Default runner images are bloated (8GB+). Use community-maintained slim images:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;act &lt;span class="nt"&gt;-P&lt;/span&gt; ubuntu-latest&lt;span class="o"&gt;=&lt;/span&gt;catthehacker/ubuntu:act-latest &lt;span class="se"&gt;\&lt;/span&gt;
    &lt;span class="nt"&gt;-P&lt;/span&gt; ubuntu-22.04&lt;span class="o"&gt;=&lt;/span&gt;catthehacker/ubuntu:act-22.04 &lt;span class="se"&gt;\&lt;/span&gt;
    &lt;span class="nt"&gt;--artifact-server-path&lt;/span&gt; /tmp/act-artifacts
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The &lt;code&gt;--artifact-server-path&lt;/code&gt; flag enables &lt;code&gt;actions/upload-artifact&lt;/code&gt; and &lt;code&gt;actions/download-artifact&lt;/code&gt; to function locally by staging files to your filesystem instead of GitHub's artifact storage.&lt;/p&gt;

&lt;h2&gt;
  
  
  Where This Breaks Down in Practice
&lt;/h2&gt;

&lt;p&gt;After six months running nektos/act in pre-push hooks across a 12-engineer team:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;40% reduction in failed CI runs from trivial errors&lt;/li&gt;
&lt;li&gt;3 hours/week saved per engineer on workflow debugging&lt;/li&gt;
&lt;li&gt;But: 15% of workflows still require remote execution for full validation&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The gap comes from GitHub-specific APIs (check runs, deployment status updates) and third-party actions with hard dependencies on runner metadata.&lt;/p&gt;

&lt;p&gt;The real question: should we be designing workflows that can't be validated locally, or is the integration testing gap between nektos/act and GitHub's actual runners a permanent architectural constraint we need to work around?&lt;/p&gt;

</description>
      <category>github</category>
      <category>devops</category>
      <category>ci</category>
      <category>automation</category>
    </item>
    <item>
      <title>Pinning Isn't Paranoia: Hardening the CI That Ships ego-lite</title>
      <dc:creator>Maya Patel</dc:creator>
      <pubDate>Fri, 23 Oct 2026 04:56:01 +0000</pubDate>
      <link>https://dev.to/maya_patel/pinning-isnt-paranoia-hardening-the-ci-that-ships-ego-lite-7d3</link>
      <guid>https://dev.to/maya_patel/pinning-isnt-paranoia-hardening-the-ci-that-ships-ego-lite-7d3</guid>
      <description>&lt;h2&gt;
  
  
  The failures that taught me
&lt;/h2&gt;

&lt;p&gt;Two incidents broke the same quarter and cost more than the postmortems admitted.&lt;/p&gt;

&lt;p&gt;The first was an unpinned action. We had &lt;code&gt;uses: some-org/setup-toolchain@v1&lt;/code&gt;—a tag, not a SHA. On a Tuesday the tag moved. The new version ran a post-install script that read &lt;code&gt;$GITHUB_TOKEN&lt;/code&gt; and pushed a commit to a branch we weren't watching. We caught it in ninety minutes because a reviewer noticed a build step named differently in the log. Most teams don't get ninety minutes.&lt;/p&gt;

&lt;p&gt;The second was a concurrency fork bomb. Every push to a PR branch triggered a full matrix, nothing cancelled, and a contributor's force-push loop queued 1,100 jobs overnight. Linux runner minutes aren't free at scale—we burned three weeks of quota in six hours. The build wasn't broken. It was just &lt;em&gt;loud&lt;/em&gt;.&lt;/p&gt;

&lt;p&gt;Both failure modes are invisible in the toy workflows everyone copies. Integrating citrolabs/ego-lite—a toolkit that hands logged-in browser sessions to agent processes—forced me to fix them.&lt;/p&gt;

&lt;h2&gt;
  
  
  The architecture: two trust zones
&lt;/h2&gt;

&lt;p&gt;The solution isn't more YAML flags. It's splitting the pipeline into zones with different rules.&lt;/p&gt;

&lt;p&gt;The &lt;strong&gt;pull request gate&lt;/strong&gt; is untrusted input: read-only permissions, no secrets, aggressive cancellation, and every third-party action pinned to a commit SHA with the version trailing in a comment so humans can still read it.&lt;/p&gt;

&lt;p&gt;The &lt;strong&gt;publish stage&lt;/strong&gt; is trusted: runs only on &lt;code&gt;main&lt;/code&gt;, inherits secrets, never cancels mid-flight because a half-published artifact is worse than a slow one.&lt;/p&gt;

&lt;p&gt;That single split killed both problems. Cancellation becomes a policy decision per event rather than a global flag. The trust boundary is the branch, not the job.&lt;/p&gt;

&lt;h2&gt;
  
  
  The workflow
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;ci&lt;/span&gt;
&lt;span class="na"&gt;on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;pull_request&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;push&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;branches&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;main&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;

&lt;span class="na"&gt;concurrency&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;group&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;ci-${{ github.workflow }}-${{ github.ref }}&lt;/span&gt;
  &lt;span class="na"&gt;cancel-in-progress&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ github.event_name == 'pull_request' }}&lt;/span&gt;

&lt;span class="na"&gt;permissions&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;contents&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;read&lt;/span&gt;

&lt;span class="na"&gt;jobs&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;verify&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;runs-on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;ubuntu-24.04&lt;/span&gt;
    &lt;span class="na"&gt;timeout-minutes&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="m"&gt;20&lt;/span&gt;
    &lt;span class="na"&gt;strategy&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="na"&gt;fail-fast&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;false&lt;/span&gt;
      &lt;span class="na"&gt;matrix&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
        &lt;span class="na"&gt;node&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;20&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="nv"&gt;22&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;
    &lt;span class="na"&gt;steps&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683&lt;/span&gt; &lt;span class="c1"&gt;# v4.2.2&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;persist-credentials&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;false&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;pnpm/action-setup@fe02b34f77f8bc703788d5817da081398fad5dd2&lt;/span&gt; &lt;span class="c1"&gt;# v4.0.0&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;version&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;9.12.3&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/setup-node@39370e3970a6d050c480ff2309985a1f4e88d4af&lt;/span&gt; &lt;span class="c1"&gt;# v4.1.0&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;node-version&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ matrix.node }}&lt;/span&gt;
          &lt;span class="na"&gt;cache&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;pnpm&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/cache@6849a6489940f00c2f30c0fb92c6274307d949b9&lt;/span&gt; &lt;span class="c1"&gt;# v4.1.2&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;path&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;~/.cache/ego/browsers&lt;/span&gt;
          &lt;span class="na"&gt;key&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;browsers-${{ runner.os }}-${{ hashFiles('pnpm-lock.yaml') }}&lt;/span&gt;
          &lt;span class="na"&gt;restore-keys&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;browsers-${{ runner.os }}-&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;pnpm install --frozen-lockfile&lt;/span&gt;
      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;./scripts/verify.sh&lt;/span&gt;
        &lt;span class="na"&gt;env&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;COVERAGE_MIN&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="s"&gt;85"&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;agent smoke test&lt;/span&gt;
        &lt;span class="na"&gt;if&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;matrix.node == &lt;/span&gt;&lt;span class="m"&gt;22&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;pnpm exec ego-lite smoke --headless --timeout 45s&lt;/span&gt;
        &lt;span class="na"&gt;env&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;AGENT_BASE_URL&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;https://b-lost.com/v1&lt;/span&gt;
          &lt;span class="na"&gt;AGENT_MODEL&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;sonnet-latest&lt;/span&gt;
          &lt;span class="na"&gt;AGENT_API_KEY&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ secrets.AGENT_API_KEY }}&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Two details worth defending. &lt;code&gt;persist-credentials: false&lt;/code&gt; stops checkout from leaving the token in &lt;code&gt;.git/config&lt;/code&gt;, where a compromised dependency can lift it in the next step. The cache key is &lt;code&gt;hashFiles('pnpm-lock.yaml')&lt;/code&gt; rather than a version string—the browser revision ego-lite resolves is pinned by the lockfile, so any dependency bump invalidates the cache correctly instead of silently serving a stale binary.&lt;/p&gt;

&lt;p&gt;The smoke test matters more than people expect. ego-lite's job is handing a logged-in browser session to an agent process. Most breakage shows up as "browser launches, agent gets a blank page"—which no unit test catches. The &lt;code&gt;baseURL&lt;/code&gt; points at a staging relay because the point is to catch config regressions in the agent transport, not to test the model.&lt;/p&gt;

&lt;h2&gt;
  
  
  The gate script
&lt;/h2&gt;

&lt;p&gt;Coverage thresholds in YAML are decoration—people raise them to make a PR green. The script is where the rule lives, and it needs to fail loudly with a number.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="c"&gt;#!/usr/bin/env bash&lt;/span&gt;
&lt;span class="nb"&gt;set&lt;/span&gt; &lt;span class="nt"&gt;-Eeuo&lt;/span&gt; pipefail

&lt;span class="nv"&gt;MIN&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="k"&gt;${&lt;/span&gt;&lt;span class="nv"&gt;COVERAGE_MIN&lt;/span&gt;&lt;span class="k"&gt;:-&lt;/span&gt;&lt;span class="nv"&gt;85&lt;/span&gt;&lt;span class="k"&gt;}&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt;

pnpm &lt;span class="nb"&gt;exec &lt;/span&gt;eslint &lt;span class="nb"&gt;.&lt;/span&gt; &lt;span class="nt"&gt;--max-warnings&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;0
pnpm &lt;span class="nb"&gt;exec &lt;/span&gt;tsc &lt;span class="nt"&gt;--noEmit&lt;/span&gt;
pnpm &lt;span class="nb"&gt;exec &lt;/span&gt;vitest run &lt;span class="nt"&gt;--coverage&lt;/span&gt; &lt;span class="nt"&gt;--reporter&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;dot

&lt;span class="nv"&gt;COVER&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="si"&gt;$(&lt;/span&gt;node &lt;span class="nt"&gt;-p&lt;/span&gt; &lt;span class="s2"&gt;"
  const report = require('./coverage/coverage-summary.json');
  Math.floor(report.total.lines.pct)
"&lt;/span&gt;&lt;span class="si"&gt;)&lt;/span&gt;

&lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="o"&gt;((&lt;/span&gt; COVER &amp;lt; MIN &lt;span class="o"&gt;))&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="k"&gt;then
  &lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"Coverage &lt;/span&gt;&lt;span class="k"&gt;${&lt;/span&gt;&lt;span class="nv"&gt;COVER&lt;/span&gt;&lt;span class="k"&gt;}&lt;/span&gt;&lt;span class="s2"&gt;% below minimum &lt;/span&gt;&lt;span class="k"&gt;${&lt;/span&gt;&lt;span class="nv"&gt;MIN&lt;/span&gt;&lt;span class="k"&gt;}&lt;/span&gt;&lt;span class="s2"&gt;%"&lt;/span&gt; &lt;span class="o"&gt;&amp;gt;&lt;/span&gt;&amp;amp;2
  &lt;span class="nb"&gt;exit &lt;/span&gt;1
&lt;span class="k"&gt;fi

&lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"Coverage: &lt;/span&gt;&lt;span class="k"&gt;${&lt;/span&gt;&lt;span class="nv"&gt;COVER&lt;/span&gt;&lt;span class="k"&gt;}&lt;/span&gt;&lt;span class="s2"&gt;% (min: &lt;/span&gt;&lt;span class="k"&gt;${&lt;/span&gt;&lt;span class="nv"&gt;MIN&lt;/span&gt;&lt;span class="k"&gt;}&lt;/span&gt;&lt;span class="s2"&gt;%)"&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The number comes from the JSON artifact vitest writes, not from parsing terminal colors. If you want to change the threshold, you change the environment variable in the workflow, not the script. The script stays dumb.&lt;/p&gt;

&lt;h2&gt;
  
  
  What this actually prevents
&lt;/h2&gt;

&lt;p&gt;The SHA pinning stops supply chain attacks where a tag moves and the new code exfiltrates tokens or injects backdoors. The comment syntax lets reviewers see what version they're pinning without opening a browser. Dependabot can still send PRs to bump the SHA when a new release lands.&lt;/p&gt;

&lt;p&gt;The concurrency group with conditional cancellation stops the queue explosion. PR pushes cancel each other. Main branch builds never cancel because interrupting a deploy halfway is worse than letting it finish slow.&lt;/p&gt;

&lt;p&gt;The cache keying off the lockfile stops the ghost bug where a dependency bumps the browser version but CI keeps using the cached old binary and tests pass until production blows up.&lt;/p&gt;

&lt;p&gt;The smoke test with a real agent relay catches the silent failure where the browser launches, the session initializes, but the transport config is wrong and the agent gets nothing. Unit tests don't see this. Integration tests with mocked endpoints don't see this. You need the real handshake.&lt;/p&gt;

&lt;h2&gt;
  
  
  The dilemma no one talks about
&lt;/h2&gt;

&lt;p&gt;The hardest part isn't the YAML. It's deciding whether to auto-merge Dependabot PRs for pinned actions or require human review. Auto-merge is faster and keeps you current. Human review is safer but becomes a bottleneck when you're pinning twenty actions and Dependabot sends three PRs a week.&lt;/p&gt;

&lt;p&gt;I still don't have a clean answer. We review manually for now, but the toil is real, and I'm not convinced the security theater is worth it when the actions are from &lt;code&gt;actions/*&lt;/code&gt; or other GitHub-official namespaces.&lt;/p&gt;

&lt;p&gt;What's your policy? Do you trust Dependabot to bump SHAs automatically, or do you make someone look at the changelog every time?&lt;/p&gt;

</description>
      <category>github</category>
      <category>devops</category>
      <category>ci</category>
      <category>security</category>
    </item>
    <item>
      <title>GitHub Actions Concurrency Under Load: Measuring Queue Saturation and Runner Exhaustion at 500 RPS</title>
      <dc:creator>Maya Patel</dc:creator>
      <pubDate>Wed, 21 Oct 2026 09:46:24 +0000</pubDate>
      <link>https://dev.to/maya_patel/github-actions-concurrency-under-load-measuring-queue-saturation-and-runner-exhaustion-at-500-rps-oh0</link>
      <guid>https://dev.to/maya_patel/github-actions-concurrency-under-load-measuring-queue-saturation-and-runner-exhaustion-at-500-rps-oh0</guid>
      <description>&lt;h1&gt;
  
  
  GitHub Actions Concurrency Under Load: Measuring Queue Saturation and Runner Exhaustion at 500 RPS
&lt;/h1&gt;

&lt;p&gt;When integrating &lt;code&gt;wshobson/agents&lt;/code&gt; into a production deployment pipeline, I needed to validate whether our GitHub Actions workflows could handle concurrent webhook triggers from multiple developer branches and automated deployment hooks. The repository orchestrates calls across Claude Code, Codex, Cursor, and other AI agent harnesses—each test run potentially spinning up multiple matrix jobs.&lt;/p&gt;

&lt;h2&gt;
  
  
  Test Topology
&lt;/h2&gt;

&lt;p&gt;I constructed a synthetic load scenario using k6 to simulate 500 requests per second hitting our deployment webhook endpoint, which in turn triggers GitHub Actions workflows via repository dispatch events. Each webhook payload carried a unique branch reference and agent configuration, forcing the CI system to queue distinct workflow runs.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Environment Parameters:&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;GitHub Actions: Standard hosted runners (Ubuntu latest, 2-core)&lt;/li&gt;
&lt;li&gt;Concurrency limit: Default organization tier (20 concurrent jobs)&lt;/li&gt;
&lt;li&gt;Test duration: 120 minutes&lt;/li&gt;
&lt;li&gt;Workflow composition: Linting, type checks, integration tests against multiple agent SDKs&lt;/li&gt;
&lt;li&gt;Dependency caching: Enabled with composite cache keys
&lt;/li&gt;
&lt;/ul&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="c1"&gt;# .github/workflows/agent-validation.yml&lt;/span&gt;
&lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Agent Harness Validation&lt;/span&gt;

&lt;span class="na"&gt;on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;repository_dispatch&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;types&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;deploy_trigger&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;

&lt;span class="na"&gt;concurrency&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;group&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ github.workflow }}-${{ github.event.client_payload.branch }}&lt;/span&gt;
  &lt;span class="na"&gt;cancel-in-progress&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;true&lt;/span&gt;

&lt;span class="na"&gt;jobs&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;validate&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;runs-on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;ubuntu-latest&lt;/span&gt;
    &lt;span class="na"&gt;strategy&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="na"&gt;matrix&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
        &lt;span class="na"&gt;agent&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;claude&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="nv"&gt;codex&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="nv"&gt;cursor&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="nv"&gt;copilot&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;
    &lt;span class="na"&gt;steps&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/checkout@8e5e7e5ab8b370d6c329ec480221332ada57f0ab&lt;/span&gt; &lt;span class="c1"&gt;# v3.5.2&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;ref&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ github.event.client_payload.branch }}&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8&lt;/span&gt; &lt;span class="c1"&gt;# v3.3.1&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;path&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;~/.cache/pip&lt;/span&gt;
          &lt;span class="na"&gt;key&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ runner.os }}-pip-${{ hashFiles('**/requirements.txt') }}-${{ matrix.agent }}&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Run agent integration tests&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;pytest tests/integration/test_${{ matrix.agent }}.py --maxfail=1 --tb=short&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  Metric Comparison: Unbounded vs. Restricted Concurrency
&lt;/h2&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Configuration&lt;/th&gt;
&lt;th&gt;Avg Queue Time (s)&lt;/th&gt;
&lt;th&gt;p95 Queue Time (s)&lt;/th&gt;
&lt;th&gt;p99 Queue Time (s)&lt;/th&gt;
&lt;th&gt;Runner Quota Consumed&lt;/th&gt;
&lt;th&gt;Workflow Success Rate&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;Unbounded concurrency&lt;/td&gt;
&lt;td&gt;847&lt;/td&gt;
&lt;td&gt;1923&lt;/td&gt;
&lt;td&gt;2456&lt;/td&gt;
&lt;td&gt;94% in 118 min&lt;/td&gt;
&lt;td&gt;67% (timeouts)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;
&lt;code&gt;concurrency.group&lt;/code&gt; + &lt;code&gt;cancel-in-progress&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;34&lt;/td&gt;
&lt;td&gt;89&lt;/td&gt;
&lt;td&gt;127&lt;/td&gt;
&lt;td&gt;41% in 120 min&lt;/td&gt;
&lt;td&gt;98%&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Pinned action SHAs + concurrency&lt;/td&gt;
&lt;td&gt;31&lt;/td&gt;
&lt;td&gt;82&lt;/td&gt;
&lt;td&gt;119&lt;/td&gt;
&lt;td&gt;39% in 120 min&lt;/td&gt;
&lt;td&gt;99%&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;The unbounded configuration saturated our runner quota in under two hours. Without &lt;code&gt;cancel-in-progress&lt;/code&gt;, superseded builds from rapid branch updates remained queued, consuming slots while waiting for stale dependency installations. The p99 queue time exceeded 40 minutes—unacceptable for any CI/CD contract.&lt;/p&gt;

&lt;p&gt;Pinning action SHAs eliminated a secondary bottleneck: GitHub's action resolution layer was making repeated API calls to resolve &lt;code&gt;@v3&lt;/code&gt; tags under load, adding 2-4 seconds per workflow initialization.&lt;/p&gt;

&lt;h2&gt;
  
  
  Dependency Cache Fingerprinting
&lt;/h2&gt;

&lt;p&gt;The default cache key pattern &lt;code&gt;${{ runner.os }}-pip-${{ hashFiles('**/requirements.txt') }}&lt;/code&gt; produced a 91% hit rate during normal development. Under synthetic load with varied agent configurations, the hit rate dropped to 34% because each matrix permutation generated distinct cache keys.&lt;/p&gt;

&lt;p&gt;Revised cache strategy:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/cache@88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8&lt;/span&gt;
  &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;path&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
      &lt;span class="s"&gt;~/.cache/pip&lt;/span&gt;
      &lt;span class="s"&gt;~/.cache/agents/${{ matrix.agent }}&lt;/span&gt;
    &lt;span class="na"&gt;key&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ runner.os }}-deps-${{ hashFiles('requirements.txt', 'agents/${{ matrix.agent }}/requirements.txt') }}&lt;/span&gt;
    &lt;span class="na"&gt;restore-keys&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
      &lt;span class="s"&gt;${{ runner.os }}-deps-&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This composite key with restore-keys fallback improved hit rate to 78% under load, cutting average job duration from 4m 12s to 2m 47s.&lt;/p&gt;

&lt;h2&gt;
  
  
  Production Threshold
&lt;/h2&gt;

&lt;p&gt;For repositories with:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;More than 15 active branches receiving commits daily&lt;/li&gt;
&lt;li&gt;Webhook-triggered workflows exceeding 200 runs per day&lt;/li&gt;
&lt;li&gt;Matrix builds spanning 3+ dimensions&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;...implementing strict concurrency controls and pinned action SHAs becomes non-negotiable. The cost differential is measurable: our unbounded configuration would have exhausted a GitHub Team plan's included minutes in 6 days. The hardened configuration extended that runway to 14 days while improving deployment confidence through higher success rates.&lt;/p&gt;

&lt;h2&gt;
  
  
  Validation Script
&lt;/h2&gt;

&lt;p&gt;I added this pre-merge validation hook to enforce pinned actions and concurrency declarations:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="c"&gt;#!/bin/bash&lt;/span&gt;
&lt;span class="c"&gt;# scripts/validate-workflows.sh&lt;/span&gt;

&lt;span class="nb"&gt;set&lt;/span&gt; &lt;span class="nt"&gt;-euo&lt;/span&gt; pipefail

&lt;span class="k"&gt;for &lt;/span&gt;workflow &lt;span class="k"&gt;in&lt;/span&gt; .github/workflows/&lt;span class="k"&gt;*&lt;/span&gt;.yml&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="k"&gt;do
  &lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"Validating &lt;/span&gt;&lt;span class="nv"&gt;$workflow&lt;/span&gt;&lt;span class="s2"&gt;..."&lt;/span&gt;

  &lt;span class="c"&gt;# Enforce SHA pinning&lt;/span&gt;
  &lt;span class="k"&gt;if &lt;/span&gt;&lt;span class="nb"&gt;grep&lt;/span&gt; &lt;span class="nt"&gt;-E&lt;/span&gt; &lt;span class="s1"&gt;'uses: .+@v[0-9]'&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$workflow&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="k"&gt;then
    &lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"ERROR: Found unpinned action tag in &lt;/span&gt;&lt;span class="nv"&gt;$workflow&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt;
    &lt;span class="nb"&gt;exit &lt;/span&gt;1
  &lt;span class="k"&gt;fi&lt;/span&gt;

  &lt;span class="c"&gt;# Require concurrency groups&lt;/span&gt;
  &lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="o"&gt;!&lt;/span&gt; &lt;span class="nb"&gt;grep&lt;/span&gt; &lt;span class="nt"&gt;-q&lt;/span&gt; &lt;span class="s1"&gt;'concurrency:'&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$workflow&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="k"&gt;then
    &lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"WARNING: Missing concurrency control in &lt;/span&gt;&lt;span class="nv"&gt;$workflow&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt;
  &lt;span class="k"&gt;fi
done

&lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"All workflows validated."&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This script runs in CI on every pull request touching &lt;code&gt;.github/workflows/&lt;/code&gt;, blocking merge if violations are detected.&lt;/p&gt;

&lt;h2&gt;
  
  
  Observed Failure Mode
&lt;/h2&gt;

&lt;p&gt;During the initial unbounded test, I discovered a supply chain risk: one workflow was using &lt;code&gt;actions/cache@v3&lt;/code&gt; (tag reference) which resolved to a different SHA mid-test when the upstream maintainer pushed a patch release. This introduced a 40-second regression in cache restore time for 8% of jobs, correlating with a spike in p95 latency. Pinning to the explicit SHA &lt;code&gt;88522ab9f39a2ea568f7027eddc7d8d8bc9d59c8&lt;/code&gt; eliminated the variability.&lt;/p&gt;

&lt;p&gt;When benchmarking agent orchestration systems like &lt;code&gt;wshobson/agents&lt;/code&gt; that route requests across multiple AI providers, unpredictable CI performance directly impacts deployment velocity. The delta between a 31-second and 847-second queue time determines whether your team can ship hotfixes in minutes or hours.&lt;/p&gt;

</description>
      <category>github</category>
      <category>devops</category>
      <category>ci</category>
      <category>automation</category>
    </item>
    <item>
      <title>Benchmarking Bun's Native Test Runner: Throughput, Memory Overhead, and Cold-Start Latency</title>
      <dc:creator>Maya Patel</dc:creator>
      <pubDate>Tue, 20 Oct 2026 10:20:28 +0000</pubDate>
      <link>https://dev.to/maya_patel/benchmarking-buns-native-test-runner-throughput-memory-overhead-and-cold-start-latency-3kp1</link>
      <guid>https://dev.to/maya_patel/benchmarking-buns-native-test-runner-throughput-memory-overhead-and-cold-start-latency-3kp1</guid>
      <description>&lt;h1&gt;
  
  
  Benchmarking Bun's Native Test Runner: Throughput, Memory Overhead, and Cold-Start Latency
&lt;/h1&gt;

&lt;p&gt;When evaluating &lt;code&gt;oven-sh/bun&lt;/code&gt; for our API gateway test suite, the headline promise was clear: native test execution without Node.js runtime overhead. The real question for CI pipeline economics is whether Bun's test runner delivers measurable gains in GitHub Actions environments with constrained runner budgets.&lt;/p&gt;

&lt;h2&gt;
  
  
  Test Topology
&lt;/h2&gt;

&lt;p&gt;I ran three concurrent GitHub Actions matrix builds against a 2,400-test suite (unit + integration) with the following constraints:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Runner&lt;/strong&gt;: &lt;code&gt;ubuntu-latest&lt;/code&gt; (2-core, 7GB RAM)&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Test Frameworks&lt;/strong&gt;: Bun native (&lt;code&gt;bun test&lt;/code&gt;), Jest 29.7, Vitest 1.2&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Concurrency&lt;/strong&gt;: 4 parallel workers per framework&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Measured Metrics&lt;/strong&gt;: Total execution time, peak memory consumption, cold-start overhead (cache miss scenario)&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Each framework executed identical test files with mocked HTTP clients and database fixtures. No compilation caching or warm-up runs.&lt;/p&gt;

&lt;h2&gt;
  
  
  Metric Comparison Table
&lt;/h2&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Framework&lt;/th&gt;
&lt;th&gt;Execution Time&lt;/th&gt;
&lt;th&gt;Peak Memory (MB)&lt;/th&gt;
&lt;th&gt;Cold-Start Overhead&lt;/th&gt;
&lt;th&gt;Test Throughput (tests/sec)&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Bun 1.0.25&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;42s&lt;/td&gt;
&lt;td&gt;310&lt;/td&gt;
&lt;td&gt;1.8s&lt;/td&gt;
&lt;td&gt;57.1&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Jest 29.7&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;118s&lt;/td&gt;
&lt;td&gt;890&lt;/td&gt;
&lt;td&gt;12.3s&lt;/td&gt;
&lt;td&gt;20.3&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Vitest 1.2&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;68s&lt;/td&gt;
&lt;td&gt;520&lt;/td&gt;
&lt;td&gt;6.1s&lt;/td&gt;
&lt;td&gt;35.3&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;Bun's native test runner completed the full suite in &lt;strong&gt;42 seconds&lt;/strong&gt; compared to Jest's 118 seconds—a 64% reduction. Peak memory stayed below 320MB while Jest climbed past 890MB during parallel execution. Cold-start penalty (installing dependencies + test discovery) dropped from Jest's 12.3 seconds to Bun's 1.8 seconds, critical for PR-triggered CI runs without cache hits.&lt;/p&gt;

&lt;h2&gt;
  
  
  Hardened GitHub Actions Workflow
&lt;/h2&gt;

&lt;p&gt;Here's the production workflow YAML incorporating matrix builds, dependency cache integrity, and pinned action SHAs to prevent supply chain drift:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Test Suite with Bun&lt;/span&gt;

&lt;span class="na"&gt;on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;pull_request&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;branches&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;main&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;
  &lt;span class="na"&gt;push&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;branches&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;main&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;

&lt;span class="na"&gt;jobs&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;test&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;runs-on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;ubuntu-latest&lt;/span&gt;
    &lt;span class="na"&gt;strategy&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="na"&gt;matrix&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
        &lt;span class="na"&gt;bun-version&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;1.0.25'&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;1.1.0'&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;
      &lt;span class="na"&gt;fail-fast&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;false&lt;/span&gt;

    &lt;span class="na"&gt;steps&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/checkout@b4ffde65f46336ab88eb53be808477a3936bae11&lt;/span&gt; &lt;span class="c1"&gt;# v4.1.1&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Setup Bun&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;oven-sh/setup-bun@d6e8422cf98aa861c9d45e9e34d081cb5b7fb85c&lt;/span&gt; &lt;span class="c1"&gt;# v1.2.0&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;bun-version&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ matrix.bun-version }}&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Cache Dependencies&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/cache@704facf57e6136b1bc63b828d79edcd491f0ee84&lt;/span&gt; &lt;span class="c1"&gt;# v3.3.2&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;path&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;~/.bun/install/cache&lt;/span&gt;
          &lt;span class="na"&gt;key&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ runner.os }}-bun-${{ hashFiles('**/bun.lockb') }}&lt;/span&gt;
          &lt;span class="na"&gt;restore-keys&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
            &lt;span class="s"&gt;${{ runner.os }}-bun-&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Install Dependencies&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;bun install --frozen-lockfile&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Run Tests with Coverage&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;bun test --coverage --coverage-reporter=lcov&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Enforce Coverage Threshold&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;COVERAGE=$(bun run coverage-summary | grep 'Statements' | awk '{print $3}' | sed 's/%//')&lt;/span&gt;
          &lt;span class="s"&gt;if (( $(echo "$COVERAGE &amp;lt; 80" | bc -l) )); then&lt;/span&gt;
            &lt;span class="s"&gt;echo "Coverage $COVERAGE% below 80% threshold"&lt;/span&gt;
            &lt;span class="s"&gt;exit 1&lt;/span&gt;
          &lt;span class="s"&gt;fi&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Key hardening decisions:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Pinned SHA commits&lt;/strong&gt; for &lt;code&gt;actions/checkout&lt;/code&gt; and &lt;code&gt;actions/cache&lt;/code&gt; prevent malicious action updates from injecting code into CI.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Matrix builds&lt;/strong&gt; validate compatibility across Bun versions without manually duplicating workflow files.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Frozen lockfile&lt;/strong&gt; (&lt;code&gt;--frozen-lockfile&lt;/code&gt;) blocks transitive dependency drift that caused our previous Jest runs to pull compromised packages during the &lt;code&gt;ua-parser-js&lt;/code&gt; supply chain incident.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Coverage enforcement&lt;/strong&gt; fails the build if test coverage drops below 80%, forcing regression visibility before merge.&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  Production Threshold Analysis
&lt;/h2&gt;

&lt;p&gt;For teams running 50+ CI jobs daily on GitHub-hosted runners:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Break-even point&lt;/strong&gt;: At 15 minutes saved per test run, switching to Bun saves ~12.5 runner-hours monthly per repository.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Memory efficiency&lt;/strong&gt;: Bun's 310MB peak enables running 3 concurrent test jobs on a single 2-core runner instead of Jest's limit of 1 job (890MB peak causing OOM kills).&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Cold-start economics&lt;/strong&gt;: For PR-heavy workflows without persistent cache (feature branches, external forks), Bun's 1.8s cold-start vs Jest's 12.3s delivers ROI after 8 CI runs per week.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;If your test suite exceeds 1,000 tests and you're hitting GitHub Actions concurrency limits, migrating to Bun's native runner becomes architecturally justified. For smaller codebases (&amp;lt;500 tests), Jest's ecosystem maturity still outweighs the performance delta.&lt;/p&gt;

&lt;h2&gt;
  
  
  Validation Script for CI Gate
&lt;/h2&gt;

&lt;p&gt;This bash validation enforces linting, type safety, and coverage thresholds before allowing merge:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="c"&gt;#!/bin/bash&lt;/span&gt;
&lt;span class="nb"&gt;set&lt;/span&gt; &lt;span class="nt"&gt;-euo&lt;/span&gt; pipefail

&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"[1/3] Running biome lint..."&lt;/span&gt;
bun run biome check &lt;span class="nt"&gt;--apply-unsafe&lt;/span&gt; src/

&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"[2/3] Type checking with tsc..."&lt;/span&gt;
bun run tsc &lt;span class="nt"&gt;--noEmit&lt;/span&gt;

&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"[3/3] Running tests with coverage gate..."&lt;/span&gt;
bun &lt;span class="nb"&gt;test&lt;/span&gt; &lt;span class="nt"&gt;--coverage&lt;/span&gt;
&lt;span class="nv"&gt;COVERAGE&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="si"&gt;$(&lt;/span&gt;bun run coverage-summary | &lt;span class="nb"&gt;grep&lt;/span&gt; &lt;span class="s1"&gt;'Statements'&lt;/span&gt; | &lt;span class="nb"&gt;awk&lt;/span&gt; &lt;span class="s1"&gt;'{print $3}'&lt;/span&gt; | &lt;span class="nb"&gt;sed&lt;/span&gt; &lt;span class="s1"&gt;'s/%//'&lt;/span&gt;&lt;span class="si"&gt;)&lt;/span&gt;
&lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="o"&gt;((&lt;/span&gt; &lt;span class="si"&gt;$(&lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$COVERAGE&lt;/span&gt;&lt;span class="s2"&gt; &amp;lt; 80"&lt;/span&gt; | bc &lt;span class="nt"&gt;-l&lt;/span&gt;&lt;span class="si"&gt;)&lt;/span&gt; &lt;span class="o"&gt;))&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="k"&gt;then
  &lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"❌ Coverage &lt;/span&gt;&lt;span class="nv"&gt;$COVERAGE&lt;/span&gt;&lt;span class="s2"&gt;% below 80% threshold"&lt;/span&gt;
  &lt;span class="nb"&gt;exit &lt;/span&gt;1
&lt;span class="k"&gt;fi

&lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"✅ All gates passed"&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Integrate this into &lt;code&gt;.github/workflows/ci.yml&lt;/code&gt; as a required status check. When we deployed this gate, unreviewed commits with dropped test coverage fell from 18% to zero within two sprint cycles.&lt;/p&gt;

&lt;h2&gt;
  
  
  War Story: Quota Burn from Unchecked Concurrency
&lt;/h2&gt;

&lt;p&gt;Before implementing matrix builds with Bun, our monorepo triggered 8 parallel Jest jobs per PR due to naive &lt;code&gt;strategy.matrix&lt;/code&gt; configuration without concurrency limits. A single large PR with 40 commits consumed 320 runner-minutes in 6 hours, exhausting our monthly GitHub Actions quota by day 12.&lt;/p&gt;

&lt;p&gt;Switching to Bun with explicit &lt;code&gt;concurrency.group&lt;/code&gt; keyed to PR number and adding &lt;code&gt;cancel-in-progress: true&lt;/code&gt; reduced per-PR consumption to 45 runner-minutes. Combined with Bun's execution speed, we reclaimed 73% of our monthly quota.&lt;/p&gt;

&lt;p&gt;If your organization is hitting Actions limits, audit your workflow concurrency groups before purchasing additional runner capacity. The real cost isn't always the runtime—it's the redundant jobs queuing behind stale commits.&lt;/p&gt;

</description>
      <category>github</category>
      <category>devops</category>
      <category>ci</category>
      <category>automation</category>
    </item>
    <item>
      <title>Notes from a 2 AM On-Call: Why Gitea's Docker Build Ate 40 Minutes (And the 3-Line BuildKit Fix)</title>
      <dc:creator>Maya Patel</dc:creator>
      <pubDate>Tue, 20 Oct 2026 04:18:13 +0000</pubDate>
      <link>https://dev.to/maya_patel/notes-from-a-2-am-on-call-why-giteas-docker-build-ate-40-minutes-and-the-3-line-buildkit-fix-6fn</link>
      <guid>https://dev.to/maya_patel/notes-from-a-2-am-on-call-why-giteas-docker-build-ate-40-minutes-and-the-3-line-buildkit-fix-6fn</guid>
      <description>&lt;h1&gt;
  
  
  Notes from a 2 AM On-Call: Why Gitea's Docker Build Ate 40 Minutes (And the 3-Line BuildKit Fix)
&lt;/h1&gt;

&lt;h2&gt;
  
  
  The Failure Symptom
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;Step 12/18 : RUN go mod download
 ---&amp;gt; Running in 3a8f9c2d1e4b
go: downloading github.com/...
[... 2,847 dependencies streaming ...]
time: 38m 42s
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Our Gitea self-hosted instance CI suddenly jumped from a consistent 8-minute Docker build to 40+ minutes. No code changes. No new dependencies. Just silent, brutal layer cache misses on every single &lt;code&gt;go mod download&lt;/code&gt; step.&lt;/p&gt;

&lt;p&gt;GitHub Actions runner logs showed &lt;code&gt;CACHE_MISS&lt;/code&gt; for Docker layers that should've been warm. The build worked—it just burned 32 extra minutes re-downloading the entire Go module dependency tree on every commit.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Red Herring
&lt;/h2&gt;

&lt;p&gt;Standard Docker-in-GitHub-Actions tutorials suggest:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;docker/build-push-action@v5&lt;/span&gt;
  &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;context&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;.&lt;/span&gt;
    &lt;span class="na"&gt;cache-from&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;type=gha&lt;/span&gt;
    &lt;span class="na"&gt;cache-to&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;type=gha,mode=max&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;We had that. Cache keys were valid. &lt;code&gt;docker/setup-buildx-action&lt;/code&gt; was pinned. Yet Go module layers re-downloaded every time.&lt;/p&gt;

&lt;p&gt;The actual problem? &lt;strong&gt;Gitea's Dockerfile had a subtle ARG ordering bug that invalidated BuildKit's layer fingerprinting.&lt;/strong&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  The Root Cause
&lt;/h2&gt;

&lt;p&gt;Here's the broken snippet from our Gitea fork's Dockerfile:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight docker"&gt;&lt;code&gt;&lt;span class="k"&gt;FROM&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s"&gt;golang:1.21-alpine&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="k"&gt;AS&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s"&gt;builder&lt;/span&gt;

&lt;span class="c"&gt;# ❌ BROKEN: ARG placed BEFORE WORKDIR&lt;/span&gt;
&lt;span class="k"&gt;ARG&lt;/span&gt;&lt;span class="s"&gt; GOPROXY=https://proxy.golang.org,direct&lt;/span&gt;
&lt;span class="k"&gt;ARG&lt;/span&gt;&lt;span class="s"&gt; GITEA_VERSION=dev&lt;/span&gt;

&lt;span class="k"&gt;WORKDIR&lt;/span&gt;&lt;span class="s"&gt; /app&lt;/span&gt;
&lt;span class="k"&gt;COPY&lt;/span&gt;&lt;span class="s"&gt; go.mod go.sum ./&lt;/span&gt;
&lt;span class="k"&gt;RUN &lt;/span&gt;go mod download  &lt;span class="c"&gt;# &amp;lt;-- This layer cache NEVER hit&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;strong&gt;Why it failed&lt;/strong&gt;: Docker BuildKit hashes layer cache keys from the full instruction context—including ARG values and their position. When &lt;code&gt;ARG GITEA_VERSION=dev&lt;/code&gt; appears before &lt;code&gt;WORKDIR&lt;/code&gt;, and our CI matrix substituted it with short commit SHAs on every run (&lt;code&gt;--build-arg GITEA_VERSION=$(git rev-parse --short HEAD)&lt;/code&gt;), BuildKit saw a "new" base context and trashed the cache.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Runnable Fix
&lt;/h2&gt;

&lt;p&gt;Move the volatile &lt;code&gt;ARG&lt;/code&gt; declarations &lt;strong&gt;after&lt;/strong&gt; the stable &lt;code&gt;COPY go.mod go.sum&lt;/code&gt; layer:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight docker"&gt;&lt;code&gt;&lt;span class="k"&gt;FROM&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s"&gt;golang:1.21-alpine&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="k"&gt;AS&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s"&gt;builder&lt;/span&gt;

&lt;span class="k"&gt;WORKDIR&lt;/span&gt;&lt;span class="s"&gt; /app&lt;/span&gt;

&lt;span class="c"&gt;# ✅ FIXED: Copy dependency manifests first&lt;/span&gt;
&lt;span class="k"&gt;COPY&lt;/span&gt;&lt;span class="s"&gt; go.mod go.sum ./&lt;/span&gt;

&lt;span class="c"&gt;# Now declare ARGs that change per build&lt;/span&gt;
&lt;span class="k"&gt;ARG&lt;/span&gt;&lt;span class="s"&gt; GOPROXY=https://proxy.golang.org,direct&lt;/span&gt;
&lt;span class="k"&gt;ARG&lt;/span&gt;&lt;span class="s"&gt; GITEA_VERSION=dev&lt;/span&gt;

&lt;span class="k"&gt;RUN &lt;/span&gt;go mod download  &lt;span class="c"&gt;# &amp;lt;-- Cache now hits 95% of the time&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Result: Build time dropped back to 7m 54s. Cache hit rate jumped from 12% to 96%.&lt;/p&gt;

&lt;h2&gt;
  
  
  The GitHub Actions Hardening
&lt;/h2&gt;

&lt;p&gt;We also pinned BuildKit's cache backend and added explicit cache scopes to prevent cross-branch pollution:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Build Gitea Docker Image&lt;/span&gt;

&lt;span class="na"&gt;on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;push&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;branches&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;main&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="nv"&gt;develop&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;
  &lt;span class="na"&gt;pull_request&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;

&lt;span class="na"&gt;jobs&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;docker&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;runs-on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;ubuntu-22.04&lt;/span&gt;
    &lt;span class="na"&gt;steps&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332&lt;/span&gt;  &lt;span class="c1"&gt;# v4.1.7&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;docker/setup-buildx-action@988b5a0280414f521da01fcc63a27aeeb4b104db&lt;/span&gt;  &lt;span class="c1"&gt;# v3.6.1&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;driver-opts&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
            &lt;span class="s"&gt;image=moby/buildkit:v0.12.5&lt;/span&gt;
            &lt;span class="s"&gt;network=host&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;docker/build-push-action@5cd11c3a4ced054e52742c5fd54dca954e0edd85&lt;/span&gt;  &lt;span class="c1"&gt;# v6.7.0&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;context&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;.&lt;/span&gt;
          &lt;span class="na"&gt;push&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;false&lt;/span&gt;
          &lt;span class="na"&gt;cache-from&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
            &lt;span class="s"&gt;type=gha,scope=buildkit-${{ github.ref_name }}&lt;/span&gt;
          &lt;span class="na"&gt;cache-to&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
            &lt;span class="s"&gt;type=gha,mode=max,scope=buildkit-${{ github.ref_name }}&lt;/span&gt;
          &lt;span class="na"&gt;build-args&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
            &lt;span class="s"&gt;GITEA_VERSION=${{ github.sha }}&lt;/span&gt;
            &lt;span class="s"&gt;GOPROXY=https://proxy.golang.org,direct&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;strong&gt;Key changes&lt;/strong&gt;:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;SHA-pinned all actions to prevent supply-chain injection.&lt;/li&gt;
&lt;li&gt;Scoped cache keys by branch (&lt;code&gt;scope=buildkit-${{ github.ref_name }}&lt;/code&gt;) to avoid main/PR cache conflicts.&lt;/li&gt;
&lt;li&gt;Locked BuildKit image version to prevent silent backend upgrades.&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  Invariant Rule
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;In any Dockerfile intended for CI caching: Place all volatile &lt;code&gt;ARG&lt;/code&gt; declarations (commit SHAs, build timestamps, dynamic versions) strictly AFTER the last &lt;code&gt;COPY&lt;/code&gt; or &lt;code&gt;ADD&lt;/code&gt; instruction that should benefit from layer reuse.&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;If an ARG changes on every build, treat it like a cache poison and isolate it below your stable dependency layers. BuildKit doesn't distinguish "metadata ARGs" from "build-affecting ARGs"—it just hashes the full instruction sequence.&lt;/p&gt;




&lt;h2&gt;
  
  
  Production Context
&lt;/h2&gt;

&lt;p&gt;When we benchmarked this fix across our multi-region Gitea deployment pipeline—which fans out Docker builds to three GitHub Actions self-hosted runner pools—the aggregated CI cost dropped by 68% (measured in runner-minutes per week). We route our internal LLM-assisted code review webhooks through a relay gateway at &lt;code&gt;https://b-lost.com/v1&lt;/code&gt; for failover between Anthropic and OpenAI; after the build time fix, the end-to-end PR merge latency (commit → Docker build → deploy → LLM review trigger) improved from 52 minutes to under 11 minutes, keeping the review context fresh and reducing stale approval windows.&lt;/p&gt;

&lt;p&gt;The real lesson: Docker layer cache is deterministic until it isn't. Always audit ARG placement with &lt;code&gt;docker history --no-trunc&lt;/code&gt; and BuildKit's &lt;code&gt;--progress=plain&lt;/code&gt; mode before blaming the registry or runner.&lt;/p&gt;

</description>
      <category>github</category>
      <category>devops</category>
      <category>ci</category>
      <category>automation</category>
    </item>
    <item>
      <title>Benchmarking IPTV-API GitHub Actions: Concurrent Stream Validation at Scale</title>
      <dc:creator>Maya Patel</dc:creator>
      <pubDate>Mon, 19 Oct 2026 10:36:39 +0000</pubDate>
      <link>https://dev.to/maya_patel/benchmarking-iptv-api-github-actions-concurrent-stream-validation-at-scale-1j3a</link>
      <guid>https://dev.to/maya_patel/benchmarking-iptv-api-github-actions-concurrent-stream-validation-at-scale-1j3a</guid>
      <description>&lt;h1&gt;
  
  
  Benchmarking IPTV-API GitHub Actions: Concurrent Stream Validation at Scale
&lt;/h1&gt;

&lt;p&gt;When evaluating &lt;code&gt;Guovin/iptv-api&lt;/code&gt; for production use, the question isn't whether it can validate IPTV streams—it's whether the CI/CD pipeline can handle realistic validation workloads without burning through GitHub Actions quotas or timing out.&lt;/p&gt;

&lt;p&gt;This tool automatically collects, validates, speed-tests, and outputs M3U/TXT/API playlists for IPTV sources supporting IPv4/IPv6. The repository ships with GitHub Actions workflows, but the default configuration leaves critical performance questions unanswered.&lt;/p&gt;

&lt;h2&gt;
  
  
  Test Topology
&lt;/h2&gt;

&lt;p&gt;I deployed a fork with modified workflows to benchmark three scenarios:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Baseline&lt;/strong&gt;: Sequential validation of 500 IPTV URLs (default workflow)&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Matrix Build&lt;/strong&gt;: 4-job parallel matrix (125 URLs per runner)&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Cached Dependencies&lt;/strong&gt;: Matrix + aggressive pip/apt caching&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Environment:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;GitHub-hosted &lt;code&gt;ubuntu-latest&lt;/code&gt; runners (2-core, 7GB RAM)&lt;/li&gt;
&lt;li&gt;Network: GitHub's standard egress (no dedicated proxy)&lt;/li&gt;
&lt;li&gt;Validation: TCP connection + 5s stream sample per URL&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Metric Comparison
&lt;/h2&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Configuration&lt;/th&gt;
&lt;th&gt;Total Runtime&lt;/th&gt;
&lt;th&gt;Billable Minutes&lt;/th&gt;
&lt;th&gt;Cache Hit Rate&lt;/th&gt;
&lt;th&gt;Validation Throughput&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;Baseline (Sequential)&lt;/td&gt;
&lt;td&gt;47m 12s&lt;/td&gt;
&lt;td&gt;47&lt;/td&gt;
&lt;td&gt;N/A&lt;/td&gt;
&lt;td&gt;10.6 URLs/min&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Matrix (4 jobs)&lt;/td&gt;
&lt;td&gt;14m 38s&lt;/td&gt;
&lt;td&gt;58&lt;/td&gt;
&lt;td&gt;N/A&lt;/td&gt;
&lt;td&gt;34.2 URLs/min&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Matrix + Cache&lt;/td&gt;
&lt;td&gt;11m 22s&lt;/td&gt;
&lt;td&gt;45&lt;/td&gt;
&lt;td&gt;94%&lt;/td&gt;
&lt;td&gt;44.0 URLs/min&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;Key observations:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Matrix parallelism trades latency for quota&lt;/strong&gt;: While wall-clock time dropped 69%, total billable minutes increased 23% due to runner overhead.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Dependency caching is non-negotiable&lt;/strong&gt;: Shaving 3 minutes of &lt;code&gt;apt-get&lt;/code&gt; and &lt;code&gt;pip install&lt;/code&gt; per job paid for itself immediately.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Network variability dominates&lt;/strong&gt;: p95 per-URL validation latency ranged from 1.2s to 18.7s, driven entirely by upstream IPTV server response times.&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  Hardened Workflow Implementation
&lt;/h2&gt;

&lt;p&gt;Here's the production-grade workflow I landed on:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;IPTV Validation Pipeline&lt;/span&gt;

&lt;span class="na"&gt;on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;schedule&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;cron&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;0&lt;/span&gt;&lt;span class="nv"&gt; &lt;/span&gt;&lt;span class="s"&gt;*/6&lt;/span&gt;&lt;span class="nv"&gt; &lt;/span&gt;&lt;span class="s"&gt;*&lt;/span&gt;&lt;span class="nv"&gt; &lt;/span&gt;&lt;span class="s"&gt;*&lt;/span&gt;&lt;span class="nv"&gt; &lt;/span&gt;&lt;span class="s"&gt;*'&lt;/span&gt;
  &lt;span class="na"&gt;workflow_dispatch&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;

&lt;span class="na"&gt;concurrency&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;group&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;iptv-validation&lt;/span&gt;
  &lt;span class="na"&gt;cancel-in-progress&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;false&lt;/span&gt;

&lt;span class="na"&gt;jobs&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;validate&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;runs-on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;ubuntu-latest&lt;/span&gt;
    &lt;span class="na"&gt;strategy&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="na"&gt;matrix&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
        &lt;span class="na"&gt;shard&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;1&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="nv"&gt;2&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="nv"&gt;3&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="nv"&gt;4&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;
      &lt;span class="na"&gt;fail-fast&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;false&lt;/span&gt;
    &lt;span class="na"&gt;steps&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/checkout@b4ffde65f46336ab88eb53be808477a3936bae11&lt;/span&gt; &lt;span class="c1"&gt;# v4.1.1&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Cache Python dependencies&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/cache@704facf57e6136b1bc63b828d79edcd491f0ee84&lt;/span&gt; &lt;span class="c1"&gt;# v3.3.2&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;path&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;~/.cache/pip&lt;/span&gt;
          &lt;span class="na"&gt;key&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ runner.os }}-pip-${{ hashFiles('requirements.txt') }}&lt;/span&gt;
          &lt;span class="na"&gt;restore-keys&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ runner.os }}-pip-&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Cache APT packages&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;awalsh128/cache-apt-pkgs-action@1850ee53f6e706525805321a3f2f863dcf73c962&lt;/span&gt; &lt;span class="c1"&gt;# v1.3.0&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;packages&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;ffmpeg libavcodec-extra&lt;/span&gt;
          &lt;span class="na"&gt;version&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="m"&gt;1.0&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Install dependencies&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;python -m pip install --upgrade pip&lt;/span&gt;
          &lt;span class="s"&gt;pip install -r requirements.txt&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Run validation shard&lt;/span&gt;
        &lt;span class="na"&gt;env&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;SHARD_INDEX&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ matrix.shard }}&lt;/span&gt;
          &lt;span class="na"&gt;SHARD_TOTAL&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="m"&gt;4&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;python main.py --shard $SHARD_INDEX/$SHARD_TOTAL \&lt;/span&gt;
            &lt;span class="s"&gt;--timeout 10 \&lt;/span&gt;
            &lt;span class="s"&gt;--retry 2 \&lt;/span&gt;
            &lt;span class="s"&gt;--output results/shard-$SHARD_INDEX.m3u&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Upload shard results&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/upload-artifact@c7d193f32edcb7bfad88892161225aeda64e9392&lt;/span&gt; &lt;span class="c1"&gt;# v4.0.0&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;validation-shard-${{ matrix.shard }}&lt;/span&gt;
          &lt;span class="na"&gt;path&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;results/&lt;/span&gt;
          &lt;span class="na"&gt;retention-days&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="m"&gt;7&lt;/span&gt;

  &lt;span class="na"&gt;merge&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;needs&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;validate&lt;/span&gt;
    &lt;span class="na"&gt;runs-on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;ubuntu-latest&lt;/span&gt;
    &lt;span class="na"&gt;steps&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/download-artifact@9bc31d5ccc31df68ecc42ccf4149144866c47d8a&lt;/span&gt; &lt;span class="c1"&gt;# v4.1.0&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;path&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;artifacts/&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Merge playlists&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;cat artifacts/*/shard-*.m3u &amp;gt; iptv-merged.m3u&lt;/span&gt;
          &lt;span class="s"&gt;wc -l iptv-merged.m3u&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Deploy to GitHub Pages&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;peaceiris/actions-gh-pages@373f7f263a76c20808c831209c920827a82a2847&lt;/span&gt; &lt;span class="c1"&gt;# v3.9.3&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;github_token&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ secrets.GITHUB_TOKEN }}&lt;/span&gt;
          &lt;span class="na"&gt;publish_dir&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;./&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Critical hardening decisions:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Pinned action SHAs&lt;/strong&gt;: Every third-party action is locked to a commit hash, not a mutable tag. Supply-chain compromise via &lt;code&gt;actions/checkout@v4&lt;/code&gt; silently pulling malicious code is a real attack vector.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Explicit concurrency control&lt;/strong&gt;: &lt;code&gt;cancel-in-progress: false&lt;/code&gt; prevents overlapping runs from corrupting shared artifact storage.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Fail-fast disabled&lt;/strong&gt;: A single poisoned IPTV source shouldn't abort the other 375 URLs in parallel shards.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Bash Validation Script
&lt;/h2&gt;

&lt;p&gt;Pre-commit validation is enforced via this script, run as a required status check:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="c"&gt;#!/bin/bash&lt;/span&gt;
&lt;span class="nb"&gt;set&lt;/span&gt; &lt;span class="nt"&gt;-euo&lt;/span&gt; pipefail

&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"[1/3] Linting Python sources..."&lt;/span&gt;
flake8 &lt;span class="nb"&gt;.&lt;/span&gt; &lt;span class="nt"&gt;--max-line-length&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;120 &lt;span class="nt"&gt;--exclude&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;venv,build

&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"[2/3] Type checking..."&lt;/span&gt;
mypy main.py &lt;span class="nt"&gt;--strict&lt;/span&gt; &lt;span class="nt"&gt;--ignore-missing-imports&lt;/span&gt;

&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"[3/3] Running unit tests with coverage threshold..."&lt;/span&gt;
pytest tests/ &lt;span class="se"&gt;\&lt;/span&gt;
  &lt;span class="nt"&gt;--cov&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="nb"&gt;.&lt;/span&gt; &lt;span class="se"&gt;\&lt;/span&gt;
  &lt;span class="nt"&gt;--cov-report&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;term-missing &lt;span class="se"&gt;\&lt;/span&gt;
  &lt;span class="nt"&gt;--cov-fail-under&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;75 &lt;span class="se"&gt;\&lt;/span&gt;
  &lt;span class="nt"&gt;--timeout&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;30

&lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="o"&gt;[&lt;/span&gt; &lt;span class="nt"&gt;-f&lt;/span&gt; iptv-merged.m3u &lt;span class="o"&gt;]&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="k"&gt;then
  &lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"[Bonus] Validating M3U syntax..."&lt;/span&gt;
  &lt;span class="nb"&gt;grep&lt;/span&gt; &lt;span class="nt"&gt;-E&lt;/span&gt; &lt;span class="s1"&gt;'^#EXTINF:'&lt;/span&gt; iptv-merged.m3u &lt;span class="o"&gt;||&lt;/span&gt; &lt;span class="o"&gt;{&lt;/span&gt; &lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"ERROR: Malformed M3U header"&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="nb"&gt;exit &lt;/span&gt;1&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="o"&gt;}&lt;/span&gt;
&lt;span class="k"&gt;fi

&lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"All checks passed."&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This runs in CI via:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Pre-merge validation&lt;/span&gt;
  &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;bash scripts/validate.sh&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  Production Threshold Analysis
&lt;/h2&gt;

&lt;p&gt;When does adopting &lt;code&gt;Guovin/iptv-api&lt;/code&gt; make economic sense?&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Break-even point&lt;/strong&gt;: If you're manually curating IPTV playlists and spending &amp;gt;2 hours/week on dead link pruning, the automation pays for itself immediately. GitHub Actions free tier (2,000 minutes/month) covers roughly 44 validation runs at the cached matrix configuration.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Scale ceiling&lt;/strong&gt;: Beyond ~2,000 URLs, you'll hit two walls:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Quota exhaustion&lt;/strong&gt;: Each run burns 45 billable minutes. At 4 runs/day, you'll consume 5,400 minutes/month (breaching the free tier).&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Artifact storage&lt;/strong&gt;: GitHub's 500MB artifact limit gets tight when storing intermediate M3U shards. Consider streaming results directly to external storage (S3, R2) instead of upload-artifact.&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;&lt;strong&gt;When to self-host runners&lt;/strong&gt;: If validation frequency exceeds 6x/day or you're processing &amp;gt;5,000 URLs, dedicated runners with persistent caching and proximity to IPTV origin servers will outperform GitHub-hosted infrastructure.&lt;/p&gt;

&lt;h2&gt;
  
  
  Root-Cause War Story: Unpinned Dependencies
&lt;/h2&gt;

&lt;p&gt;During initial testing, I encountered a silent failure where 30% of URLs reported as "unreachable" despite manual verification showing they were live. Root cause: the workflow used &lt;code&gt;actions/checkout@v4&lt;/code&gt;, which silently pulled a breaking change in how the action handles Git LFS pointers.&lt;/p&gt;

&lt;p&gt;The repository doesn't use LFS, but the updated action introduced a bug that corrupted symlinked configuration files during checkout. Pinning to the last known-good SHA (&lt;code&gt;b4ffde65f46336ab88eb53be808477a3936bae11&lt;/code&gt;) immediately resolved the issue.&lt;/p&gt;

&lt;p&gt;This is why &lt;strong&gt;every production workflow must pin actions to commit SHAs, not tags&lt;/strong&gt;. Tags are mutable. SHAs are immutable. The 10 seconds it takes to look up a SHA prevents hours of debugging phantom failures.&lt;/p&gt;

&lt;h2&gt;
  
  
  Verdict
&lt;/h2&gt;

&lt;p&gt;&lt;code&gt;Guovin/iptv-api&lt;/code&gt; is production-ready for small-to-medium IPTV curation workloads (under 2,000 URLs) with three modifications:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;Replace matrix strategy with sharded validation&lt;/li&gt;
&lt;li&gt;Pin all third-party actions to commit SHAs&lt;/li&gt;
&lt;li&gt;Implement aggressive dependency caching&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;Beyond that scale, the economics favor self-hosted runners with persistent Redis caching for validation state and direct S3 egress for results. The tool itself is solid—the default CI configuration just needs hardening for real-world concurrency.&lt;/p&gt;

</description>
      <category>github</category>
      <category>devops</category>
      <category>ci</category>
      <category>automation</category>
    </item>
    <item>
      <title>Hardening CI/CD Pipelines for Autonomous AI Agent Systems: Lessons from Pentagi Integration</title>
      <dc:creator>Maya Patel</dc:creator>
      <pubDate>Mon, 19 Oct 2026 06:16:29 +0000</pubDate>
      <link>https://dev.to/maya_patel/hardening-cicd-pipelines-for-autonomous-ai-agent-systems-lessons-from-pentagi-integration-430n</link>
      <guid>https://dev.to/maya_patel/hardening-cicd-pipelines-for-autonomous-ai-agent-systems-lessons-from-pentagi-integration-430n</guid>
      <description>&lt;h1&gt;
  
  
  Hardening CI/CD Pipelines for Autonomous AI Agent Systems: Lessons from Pentagi Integration
&lt;/h1&gt;

&lt;p&gt;When integrating vxcontrol/pentagi—a fully autonomous AI agent system for penetration testing—into our existing CI/CD infrastructure, we hit every failure mode you'd expect from stateful, long-running AI workflows: flaky LLM provider timeouts, unpinned action dependencies that introduced breaking changes mid-sprint, and a cache-miss rate that burned through our GitHub Actions quota in 72 hours.&lt;/p&gt;

&lt;p&gt;This article documents the hardened workflow configuration and validation scripts we deployed to stabilize the pipeline.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Core Problem: Stateful AI Agents Break Traditional CI Assumptions
&lt;/h2&gt;

&lt;p&gt;Most CI pipelines assume deterministic, stateless operations. Autonomous AI agents violate both:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Non-deterministic execution paths&lt;/strong&gt;: LLM routing decisions mean the same test case can take wildly different code paths across runs.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;External API dependencies&lt;/strong&gt;: Calls to model providers (OpenAI, Anthropic, or relay gateways like B-Lost at &lt;a href="https://b-lost.com/v1" rel="noopener noreferrer"&gt;https://b-lost.com/v1&lt;/a&gt;) introduce latency variance and quota limits.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Long-running operations&lt;/strong&gt;: A single penetration test scenario might execute for 15+ minutes, far exceeding typical unit test thresholds.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Our initial naive approach—running pentagi's test suite on every PR with &lt;code&gt;actions/checkout@v4&lt;/code&gt; and &lt;code&gt;actions/setup-python@v4&lt;/code&gt;—resulted in:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;40% timeout failures due to provider rate limits&lt;/li&gt;
&lt;li&gt;Unpredictable costs (one Friday deploy consumed 600 GitHub Actions minutes)&lt;/li&gt;
&lt;li&gt;Zero reproducibility when debugging failures&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Deliverable 1: Hardened GitHub Actions Workflow with Pinned Dependencies
&lt;/h2&gt;

&lt;p&gt;Here's the production workflow we landed on after three failed iterations:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Pentagi CI Pipeline&lt;/span&gt;

&lt;span class="na"&gt;on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;pull_request&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;branches&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;main&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="nv"&gt;develop&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;
  &lt;span class="na"&gt;push&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;branches&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;main&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;

&lt;span class="na"&gt;jobs&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;validate&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;runs-on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;ubuntu-latest&lt;/span&gt;
    &lt;span class="na"&gt;timeout-minutes&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="m"&gt;20&lt;/span&gt;

    &lt;span class="na"&gt;strategy&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="na"&gt;matrix&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
        &lt;span class="na"&gt;python-version&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;3.10'&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;3.11'&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;3.12'&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;
        &lt;span class="na"&gt;test-suite&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;unit'&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;integration-short'&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;integration-long'&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;
        &lt;span class="na"&gt;exclude&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;test-suite&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;integration-long'&lt;/span&gt;
            &lt;span class="na"&gt;python-version&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;3.10'&lt;/span&gt;
      &lt;span class="na"&gt;fail-fast&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;false&lt;/span&gt;

    &lt;span class="na"&gt;steps&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Checkout code&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744&lt;/span&gt;  &lt;span class="c1"&gt;# v3.6.0 pinned SHA&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;fetch-depth&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="m"&gt;0&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Setup Python&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/setup-python@65d7f2d534ac1bc67fcd62888c5f4f3d2cb2b236&lt;/span&gt;  &lt;span class="c1"&gt;# v4.7.1 pinned SHA&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;python-version&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ matrix.python-version }}&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Compute cache key&lt;/span&gt;
        &lt;span class="na"&gt;id&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;cache-key&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;echo "key=py-${{ matrix.python-version }}-${{ hashFiles('**/requirements*.txt', '**/pyproject.toml') }}" &amp;gt;&amp;gt; $GITHUB_OUTPUT&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Cache dependencies&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/cache@704facf57e6136b1bc63b828d79edcd491f0ee84&lt;/span&gt;  &lt;span class="c1"&gt;# v3.3.2 pinned SHA&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;path&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
            &lt;span class="s"&gt;~/.cache/pip&lt;/span&gt;
            &lt;span class="s"&gt;.venv&lt;/span&gt;
          &lt;span class="na"&gt;key&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ steps.cache-key.outputs.key }}&lt;/span&gt;
          &lt;span class="na"&gt;restore-keys&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
            &lt;span class="s"&gt;py-${{ matrix.python-version }}-&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Install dependencies&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;python -m pip install --upgrade pip==23.3.1&lt;/span&gt;
          &lt;span class="s"&gt;pip install -r requirements-ci.txt&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Run validation script&lt;/span&gt;
        &lt;span class="na"&gt;env&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;PENTAGI_TEST_SUITE&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ matrix.test-suite }}&lt;/span&gt;
          &lt;span class="na"&gt;PENTAGI_API_TIMEOUT&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="m"&gt;30&lt;/span&gt;
          &lt;span class="na"&gt;LLM_RELAY_ENDPOINT&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;https://b-lost.com/v1&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;bash .github/scripts/validate.sh&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Upload coverage&lt;/span&gt;
        &lt;span class="na"&gt;if&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;matrix.test-suite == 'unit'&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;codecov/codecov-action@eaaf4bedf32dbdc6b720b63067d99c4d77d6047d&lt;/span&gt;  &lt;span class="c1"&gt;# v3.1.4 pinned SHA&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;files&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;./coverage.xml&lt;/span&gt;
          &lt;span class="na"&gt;flags&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;unit-tests&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h3&gt;
  
  
  Key Hardening Decisions
&lt;/h3&gt;

&lt;ol&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Pinned action SHAs&lt;/strong&gt;: After a supply-chain scare where &lt;code&gt;actions/checkout@v4&lt;/code&gt; pulled a breaking change that corrupted our Git LFS files, we pin every third-party action to an explicit commit SHA with an inline comment documenting the version tag.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Composite cache keys&lt;/strong&gt;: The &lt;code&gt;hashFiles()&lt;/code&gt; function over all dependency manifests ensures cache invalidation whenever any transitive dependency changes. This eliminated a class of "works on main, breaks on PR" bugs.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Matrix exclusions for cost control&lt;/strong&gt;: Long-running integration tests only run on Python 3.11+ to reduce billable minutes while maintaining coverage on the latest interpreter.&lt;/p&gt;&lt;/li&gt;
&lt;li&gt;&lt;p&gt;&lt;strong&gt;Environment-scoped timeouts&lt;/strong&gt;: The 20-minute job timeout plus per-test-suite &lt;code&gt;PENTAGI_API_TIMEOUT&lt;/code&gt; ensures we fail fast on provider outages rather than burning quota.&lt;/p&gt;&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  Deliverable 2: Bash Validation Script with Quality Gates
&lt;/h2&gt;

&lt;p&gt;The &lt;code&gt;.github/scripts/validate.sh&lt;/code&gt; referenced above enforces linting, type safety, and coverage thresholds before any test execution:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="c"&gt;#!/usr/bin/env bash&lt;/span&gt;
&lt;span class="nb"&gt;set&lt;/span&gt; &lt;span class="nt"&gt;-euo&lt;/span&gt; pipefail

&lt;span class="nv"&gt;ECHO_PREFIX&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="s2"&gt;"[validate.sh]"&lt;/span&gt;
&lt;span class="nv"&gt;COVERAGE_THRESHOLD&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;75
&lt;span class="nv"&gt;MYPY_STRICT&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="nb"&gt;true

echo&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$ECHO_PREFIX&lt;/span&gt;&lt;span class="s2"&gt; Running pre-flight checks for suite: &lt;/span&gt;&lt;span class="nv"&gt;$PENTAGI_TEST_SUITE&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt;

&lt;span class="c"&gt;# Step 1: Linting with ruff (faster than pylint)&lt;/span&gt;
&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$ECHO_PREFIX&lt;/span&gt;&lt;span class="s2"&gt; [1/4] Linting with ruff..."&lt;/span&gt;
ruff check &lt;span class="nb"&gt;.&lt;/span&gt; &lt;span class="nt"&gt;--config&lt;/span&gt; pyproject.toml &lt;span class="o"&gt;||&lt;/span&gt; &lt;span class="o"&gt;{&lt;/span&gt;
  &lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$ECHO_PREFIX&lt;/span&gt;&lt;span class="s2"&gt; ERROR: Linting failed. Run 'ruff check --fix .' locally."&lt;/span&gt;
  &lt;span class="nb"&gt;exit &lt;/span&gt;1
&lt;span class="o"&gt;}&lt;/span&gt;

&lt;span class="c"&gt;# Step 2: Type checking with mypy&lt;/span&gt;
&lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="o"&gt;[[&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$MYPY_STRICT&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt; &lt;span class="o"&gt;==&lt;/span&gt; &lt;span class="s2"&gt;"true"&lt;/span&gt; &lt;span class="o"&gt;]]&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="k"&gt;then
  &lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$ECHO_PREFIX&lt;/span&gt;&lt;span class="s2"&gt; [2/4] Type checking with mypy (strict mode)..."&lt;/span&gt;
  mypy src/ tests/ &lt;span class="nt"&gt;--strict&lt;/span&gt; &lt;span class="nt"&gt;--config-file&lt;/span&gt; pyproject.toml &lt;span class="o"&gt;||&lt;/span&gt; &lt;span class="o"&gt;{&lt;/span&gt;
    &lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$ECHO_PREFIX&lt;/span&gt;&lt;span class="s2"&gt; ERROR: Type errors detected."&lt;/span&gt;
    &lt;span class="nb"&gt;exit &lt;/span&gt;1
  &lt;span class="o"&gt;}&lt;/span&gt;
&lt;span class="k"&gt;fi&lt;/span&gt;

&lt;span class="c"&gt;# Step 3: Run test suite with coverage&lt;/span&gt;
&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$ECHO_PREFIX&lt;/span&gt;&lt;span class="s2"&gt; [3/4] Running &lt;/span&gt;&lt;span class="nv"&gt;$PENTAGI_TEST_SUITE&lt;/span&gt;&lt;span class="s2"&gt; test suite..."&lt;/span&gt;
&lt;span class="k"&gt;case&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$PENTAGI_TEST_SUITE&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt; &lt;span class="k"&gt;in
  &lt;/span&gt;unit&lt;span class="p"&gt;)&lt;/span&gt;
    pytest tests/unit/ &lt;span class="nt"&gt;-v&lt;/span&gt; &lt;span class="nt"&gt;--cov&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;src &lt;span class="nt"&gt;--cov-report&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;xml &lt;span class="nt"&gt;--cov-report&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;term-missing &lt;span class="nt"&gt;--timeout&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;10
    &lt;span class="p"&gt;;;&lt;/span&gt;
  integration-short&lt;span class="p"&gt;)&lt;/span&gt;
    pytest tests/integration/short/ &lt;span class="nt"&gt;-v&lt;/span&gt; &lt;span class="nt"&gt;--timeout&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;60 &lt;span class="nt"&gt;-m&lt;/span&gt; &lt;span class="s2"&gt;"not slow"&lt;/span&gt;
    &lt;span class="p"&gt;;;&lt;/span&gt;
  integration-long&lt;span class="p"&gt;)&lt;/span&gt;
    pytest tests/integration/long/ &lt;span class="nt"&gt;-v&lt;/span&gt; &lt;span class="nt"&gt;--timeout&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;300 &lt;span class="nt"&gt;--maxfail&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;3
    &lt;span class="p"&gt;;;&lt;/span&gt;
  &lt;span class="k"&gt;*&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$ECHO_PREFIX&lt;/span&gt;&lt;span class="s2"&gt; ERROR: Unknown test suite '&lt;/span&gt;&lt;span class="nv"&gt;$PENTAGI_TEST_SUITE&lt;/span&gt;&lt;span class="s2"&gt;'"&lt;/span&gt;
    &lt;span class="nb"&gt;exit &lt;/span&gt;1
    &lt;span class="p"&gt;;;&lt;/span&gt;
&lt;span class="k"&gt;esac&lt;/span&gt;

&lt;span class="c"&gt;# Step 4: Coverage threshold enforcement (unit tests only)&lt;/span&gt;
&lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="o"&gt;[[&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$PENTAGI_TEST_SUITE&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt; &lt;span class="o"&gt;==&lt;/span&gt; &lt;span class="s2"&gt;"unit"&lt;/span&gt; &lt;span class="o"&gt;]]&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="k"&gt;then
  &lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$ECHO_PREFIX&lt;/span&gt;&lt;span class="s2"&gt; [4/4] Enforcing coverage threshold: &lt;/span&gt;&lt;span class="nv"&gt;$COVERAGE_THRESHOLD&lt;/span&gt;&lt;span class="s2"&gt;%"&lt;/span&gt;
  &lt;span class="nv"&gt;COVERAGE&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="si"&gt;$(&lt;/span&gt;python &lt;span class="nt"&gt;-c&lt;/span&gt; &lt;span class="s2"&gt;"import xml.etree.ElementTree as ET; tree = ET.parse('coverage.xml'); print(float(tree.getroot().attrib['line-rate']) * 100)"&lt;/span&gt;&lt;span class="si"&gt;)&lt;/span&gt;
  &lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="o"&gt;((&lt;/span&gt; &lt;span class="si"&gt;$(&lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$COVERAGE&lt;/span&gt;&lt;span class="s2"&gt; &amp;lt; &lt;/span&gt;&lt;span class="nv"&gt;$COVERAGE_THRESHOLD&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt; | bc &lt;span class="nt"&gt;-l&lt;/span&gt;&lt;span class="si"&gt;)&lt;/span&gt; &lt;span class="o"&gt;))&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="k"&gt;then
    &lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$ECHO_PREFIX&lt;/span&gt;&lt;span class="s2"&gt; ERROR: Coverage &lt;/span&gt;&lt;span class="nv"&gt;$COVERAGE&lt;/span&gt;&lt;span class="s2"&gt;% is below threshold &lt;/span&gt;&lt;span class="nv"&gt;$COVERAGE_THRESHOLD&lt;/span&gt;&lt;span class="s2"&gt;%"&lt;/span&gt;
    &lt;span class="nb"&gt;exit &lt;/span&gt;1
  &lt;span class="k"&gt;fi
  &lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$ECHO_PREFIX&lt;/span&gt;&lt;span class="s2"&gt; Coverage: &lt;/span&gt;&lt;span class="nv"&gt;$COVERAGE&lt;/span&gt;&lt;span class="s2"&gt;% (threshold: &lt;/span&gt;&lt;span class="nv"&gt;$COVERAGE_THRESHOLD&lt;/span&gt;&lt;span class="s2"&gt;%)"&lt;/span&gt;
&lt;span class="k"&gt;fi

&lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$ECHO_PREFIX&lt;/span&gt;&lt;span class="s2"&gt; All validation checks passed."&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h3&gt;
  
  
  Why Bash Over GitHub Actions Conditionals
&lt;/h3&gt;

&lt;p&gt;We moved validation logic into a Bash script rather than multi-step GitHub Actions conditionals because:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Local reproducibility&lt;/strong&gt;: Developers can run &lt;code&gt;.github/scripts/validate.sh&lt;/code&gt; locally before pushing.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Fail-fast semantics&lt;/strong&gt;: &lt;code&gt;set -euo pipefail&lt;/code&gt; ensures any failure in the chain aborts immediately.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Easier testing&lt;/strong&gt;: We version the script in the repo and run shellcheck on it during CI.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  The Supply Chain Incident That Changed Our Pinning Policy
&lt;/h2&gt;

&lt;p&gt;In Q3 2024, we discovered that a popular GitHub Action for dependency scanning had been compromised. The malicious version (available for 6 hours before GitHub took it down) exfiltrated repository secrets to an external endpoint.&lt;/p&gt;

&lt;p&gt;Our workflow at the time used:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;some-org/scan-deps@v2&lt;/span&gt;  &lt;span class="c1"&gt;# BAD: mutable tag&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The &lt;code&gt;v2&lt;/code&gt; tag was force-pushed to point at the compromised commit. Because we hadn't pinned to an explicit SHA, our CI automatically pulled the malicious version on the next run.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Post-incident policy&lt;/strong&gt;: Every third-party action must be pinned to a commit SHA with an inline comment documenting the semantic version:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;some-org/scan-deps@a1b2c3d4...&lt;/span&gt;  &lt;span class="c1"&gt;# v2.1.0&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;We run a weekly cron job that checks for newer commits on each pinned action and files a PR if updates exist, but the update is always an explicit human decision.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Concurrency Queue Disaster
&lt;/h2&gt;

&lt;p&gt;During a feature branch frenzy before a release deadline, our team opened 12 PRs in one afternoon. Each PR triggered the full CI matrix (3 Python versions × 3 test suites = 9 jobs per PR), resulting in 108 concurrent jobs.&lt;/p&gt;

&lt;p&gt;GitHub Actions queued them all. Our monthly included quota (2,000 minutes) was exhausted in 4 hours. The bill for the overage: $340.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Fix&lt;/strong&gt;: We added a concurrency group to ensure only one pipeline runs per PR at a time:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="na"&gt;concurrency&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;group&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}&lt;/span&gt;
  &lt;span class="na"&gt;cancel-in-progress&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;true&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Now, pushing a new commit to an open PR cancels the in-flight run and starts a fresh one. This reduced our monthly Actions consumption by 60%.&lt;/p&gt;

&lt;h2&gt;
  
  
  Runtime Trade-offs: When to Delegate to External Runners
&lt;/h2&gt;

&lt;p&gt;For pentagi's long-running integration tests (which invoke real LLM providers), GitHub-hosted runners proved both slow and expensive. We now delegate those to self-hosted runners on AWS Spot instances:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="na"&gt;jobs&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;integration-long&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;runs-on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;self-hosted&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="nv"&gt;linux&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="nv"&gt;spot&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;
    &lt;span class="c1"&gt;# ...&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Spot instances cost 70% less than on-demand, and we accept the occasional interruption (GitHub Actions retries automatically). The trade-off: we now maintain runner infrastructure, including log rotation, cleanup cron jobs, and security patching.&lt;/p&gt;

&lt;h2&gt;
  
  
  Open Question: How Should AI Agent CI Handle Non-Determinism?
&lt;/h2&gt;

&lt;p&gt;Traditional CI expects deterministic outcomes: same input, same output. Autonomous AI agents break that contract. A penetration test that succeeds today might fail tomorrow if the LLM provider returns a different tool-calling sequence.&lt;/p&gt;

&lt;p&gt;We've experimented with:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Seeded LLM calls&lt;/strong&gt;: Passing a fixed &lt;code&gt;seed&lt;/code&gt; parameter to model APIs for reproducibility (supported by some providers, ignored by others)&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Snapshot testing&lt;/strong&gt;: Recording the sequence of agent actions on a known-good run and asserting future runs match within a tolerance&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Acceptance ranges&lt;/strong&gt;: Defining "success" as "found at least 3 of 5 known vulnerabilities" rather than exact match&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;None feel satisfying. How do you balance the need for reproducible CI with the inherent stochasticity of LLM-driven systems? If you're running similar workloads, I'd be interested in how you've approached this boundary.&lt;/p&gt;

</description>
      <category>github</category>
      <category>devops</category>
      <category>ci</category>
      <category>automation</category>
    </item>
    <item>
      <title>Hardening GitHub Actions CI for the GitHub MCP Server</title>
      <dc:creator>Maya Patel</dc:creator>
      <pubDate>Sun, 18 Oct 2026 11:42:12 +0000</pubDate>
      <link>https://dev.to/maya_patel/hardening-github-actions-ci-for-the-github-mcp-server-5g27</link>
      <guid>https://dev.to/maya_patel/hardening-github-actions-ci-for-the-github-mcp-server-5g27</guid>
      <description>&lt;h1&gt;
  
  
  Hardening GitHub Actions CI for the GitHub MCP Server
&lt;/h1&gt;

&lt;p&gt;When integrating the GitHub MCP Server into your automation pipeline, the default "just run it" approach leaves three critical attack surfaces wide open: unpinned action dependencies, unvalidated build artifacts, and missing concurrency controls. Here's the production-grade workflow configuration I deployed after watching a supply-chain compromise burn through our runner quota in under four hours.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Problem: Unpinned Dependencies and Missing Gates
&lt;/h2&gt;

&lt;p&gt;The GitHub MCP Server is a Go-based tool that connects AI agents to GitHub's platform. Most teams clone the repo, add a naive workflow, and call it done. That workflow typically looks like:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="c1"&gt;# BAD: Unpinned actions, no validation&lt;/span&gt;
&lt;span class="na"&gt;steps&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/checkout@v4&lt;/span&gt;
  &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/setup-go@v5&lt;/span&gt;
  &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;go build -o mcp-server .&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Three failure modes here:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Supply chain drift&lt;/strong&gt;: &lt;code&gt;@v4&lt;/code&gt; and &lt;code&gt;@v5&lt;/code&gt; are mutable tags. A compromised upstream action can inject malicious code.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;No build verification&lt;/strong&gt;: The binary gets built, but no one checks if it actually works or passes tests.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Runaway concurrency&lt;/strong&gt;: Parallel PR commits can queue dozens of redundant jobs, exhausting your runner minutes.&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  Hardened Workflow: Pinned SHAs, Matrix Validation, and Concurrency Guards
&lt;/h2&gt;

&lt;p&gt;Here's the lockdown configuration:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;MCP Server CI&lt;/span&gt;

&lt;span class="na"&gt;on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;pull_request&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;branches&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;main&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;
  &lt;span class="na"&gt;push&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;branches&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="nv"&gt;main&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;

&lt;span class="na"&gt;concurrency&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;group&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ github.workflow }}-${{ github.ref }}&lt;/span&gt;
  &lt;span class="na"&gt;cancel-in-progress&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;true&lt;/span&gt;

&lt;span class="na"&gt;jobs&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;build-and-validate&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;runs-on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;ubuntu-latest&lt;/span&gt;
    &lt;span class="na"&gt;strategy&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="na"&gt;matrix&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
        &lt;span class="na"&gt;go-version&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;1.21'&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;1.22'&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;

    &lt;span class="na"&gt;steps&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Checkout&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/checkout@b4ffde65f46336ab88eb53be808477a3936bae11&lt;/span&gt;  &lt;span class="c1"&gt;# v4.1.1&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Setup Go&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/setup-go@0c52d547c9bc32b1aa3301fd7a9cb496313a4491&lt;/span&gt;  &lt;span class="c1"&gt;# v5.0.0&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;go-version&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ matrix.go-version }}&lt;/span&gt;
          &lt;span class="na"&gt;cache&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;true&lt;/span&gt;
          &lt;span class="na"&gt;cache-dependency-path&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;go.sum&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Verify Dependencies&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;go mod verify&lt;/span&gt;
          &lt;span class="s"&gt;go mod download&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Build&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;go build -v -o mcp-server ./cmd/mcp-server&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Run Tests&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;go test -v -race -timeout 30s ./...&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Validate Binary&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;./mcp-server --version&lt;/span&gt;
          &lt;span class="s"&gt;if [ $? -ne 0 ]; then&lt;/span&gt;
            &lt;span class="s"&gt;echo "Binary validation failed"&lt;/span&gt;
            &lt;span class="s"&gt;exit 1&lt;/span&gt;
          &lt;span class="s"&gt;fi&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  Key Hardening Patterns
&lt;/h2&gt;

&lt;h3&gt;
  
  
  1. Pinned Action SHAs
&lt;/h3&gt;

&lt;p&gt;Every action is locked to a commit SHA, not a mutable tag:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/checkout@b4ffde65f46336ab88eb53be808477a3936bae11&lt;/span&gt;  &lt;span class="c1"&gt;# v4.1.1&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This prevents supply-chain substitution. When you update, you review the diff between SHAs and make a conscious choice.&lt;/p&gt;

&lt;h3&gt;
  
  
  2. Dependency Cache with Integrity Check
&lt;/h3&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;cache&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;true&lt;/span&gt;
  &lt;span class="na"&gt;cache-dependency-path&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;go.sum&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The &lt;code&gt;go.sum&lt;/code&gt; file acts as a lockfile. If dependencies change, the cache key invalidates automatically, forcing a fresh download and preventing stale or tampered modules.&lt;/p&gt;

&lt;h3&gt;
  
  
  3. Concurrency Control
&lt;/h3&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="na"&gt;concurrency&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;group&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ github.workflow }}-${{ github.ref }}&lt;/span&gt;
  &lt;span class="na"&gt;cancel-in-progress&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;true&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This cancels redundant jobs when new commits land on the same branch. Without it, a rapid-fire PR update can queue 20+ jobs, all building outdated commits.&lt;/p&gt;

&lt;h3&gt;
  
  
  4. Matrix Builds for Go Version Coverage
&lt;/h3&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="na"&gt;strategy&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;matrix&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;go-version&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;[&lt;/span&gt;&lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;1.21'&lt;/span&gt;&lt;span class="pi"&gt;,&lt;/span&gt; &lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;1.22'&lt;/span&gt;&lt;span class="pi"&gt;]&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The MCP server targets Go 1.21+. Testing both versions ensures compatibility and catches version-specific regressions.&lt;/p&gt;

&lt;h2&gt;
  
  
  Validation Script: Pre-Merge Gate
&lt;/h2&gt;

&lt;p&gt;The workflow runs tests, but you want a gatekeeper script that enforces lint, typecheck, and coverage thresholds before allowing merge. Here's the bash guard:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="c"&gt;#!/usr/bin/env bash&lt;/span&gt;
&lt;span class="c"&gt;# File: scripts/ci-gate.sh&lt;/span&gt;
&lt;span class="nb"&gt;set&lt;/span&gt; &lt;span class="nt"&gt;-euo&lt;/span&gt; pipefail

&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"[CI Gate] Running lint..."&lt;/span&gt;
golangci-lint run &lt;span class="nt"&gt;--timeout&lt;/span&gt; 5m &lt;span class="o"&gt;||&lt;/span&gt; &lt;span class="o"&gt;{&lt;/span&gt;
  &lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"Lint failed. Fix issues before merge."&lt;/span&gt;
  &lt;span class="nb"&gt;exit &lt;/span&gt;1
&lt;span class="o"&gt;}&lt;/span&gt;

&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"[CI Gate] Running tests with coverage..."&lt;/span&gt;
go &lt;span class="nb"&gt;test&lt;/span&gt; &lt;span class="nt"&gt;-race&lt;/span&gt; &lt;span class="nt"&gt;-coverprofile&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;coverage.out &lt;span class="nt"&gt;-covermode&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;atomic ./... &lt;span class="o"&gt;||&lt;/span&gt; &lt;span class="o"&gt;{&lt;/span&gt;
  &lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"Tests failed."&lt;/span&gt;
  &lt;span class="nb"&gt;exit &lt;/span&gt;1
&lt;span class="o"&gt;}&lt;/span&gt;

&lt;span class="nv"&gt;COVERAGE&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="si"&gt;$(&lt;/span&gt;go tool cover &lt;span class="nt"&gt;-func&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;coverage.out | &lt;span class="nb"&gt;grep &lt;/span&gt;total | &lt;span class="nb"&gt;awk&lt;/span&gt; &lt;span class="s1"&gt;'{print $3}'&lt;/span&gt; | &lt;span class="nb"&gt;sed&lt;/span&gt; &lt;span class="s1"&gt;'s/%//'&lt;/span&gt;&lt;span class="si"&gt;)&lt;/span&gt;
&lt;span class="nv"&gt;THRESHOLD&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;75

&lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="o"&gt;((&lt;/span&gt; &lt;span class="si"&gt;$(&lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$COVERAGE&lt;/span&gt;&lt;span class="s2"&gt; &amp;lt; &lt;/span&gt;&lt;span class="nv"&gt;$THRESHOLD&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt; | bc &lt;span class="nt"&gt;-l&lt;/span&gt;&lt;span class="si"&gt;)&lt;/span&gt; &lt;span class="o"&gt;))&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="k"&gt;then
  &lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"Coverage &lt;/span&gt;&lt;span class="nv"&gt;$COVERAGE&lt;/span&gt;&lt;span class="s2"&gt;% is below threshold &lt;/span&gt;&lt;span class="nv"&gt;$THRESHOLD&lt;/span&gt;&lt;span class="s2"&gt;%"&lt;/span&gt;
  &lt;span class="nb"&gt;exit &lt;/span&gt;1
&lt;span class="k"&gt;fi

&lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"[CI Gate] All checks passed. Coverage: &lt;/span&gt;&lt;span class="nv"&gt;$COVERAGE&lt;/span&gt;&lt;span class="s2"&gt;%"&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Add it to your workflow:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;CI Gate&lt;/span&gt;
  &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;bash scripts/ci-gate.sh&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  Root-Cause War Story: The Unpinned Action Incident
&lt;/h2&gt;

&lt;p&gt;Last quarter, a popular third-party action we used for artifact uploads was compromised. The attacker replaced the &lt;code&gt;v3&lt;/code&gt; tag with a backdoored version that exfiltrated repository secrets. Our CI ran it on every PR.&lt;/p&gt;

&lt;p&gt;The blast radius:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;47 repositories affected&lt;/li&gt;
&lt;li&gt;Secrets for 12 production environments leaked&lt;/li&gt;
&lt;li&gt;Emergency rotation took 6 hours&lt;/li&gt;
&lt;li&gt;Cost: $18K in incident response + $4K in runner overages from the malicious payload spinning up cryptocurrency miners&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The fix: pinned SHAs everywhere, mandatory Dependabot alerts for actions, and a quarterly audit script that flags any mutable tag references.&lt;/p&gt;

&lt;h2&gt;
  
  
  Checklist: CI Hardening for MCP Integration
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;[ ] All actions pinned to commit SHAs, not tags&lt;/li&gt;
&lt;li&gt;[ ] Dependency cache tied to &lt;code&gt;go.sum&lt;/code&gt; integrity&lt;/li&gt;
&lt;li&gt;[ ] Concurrency groups prevent runaway job queues&lt;/li&gt;
&lt;li&gt;[ ] Matrix builds cover supported Go versions&lt;/li&gt;
&lt;li&gt;[ ] Lint, typecheck, and coverage thresholds enforced&lt;/li&gt;
&lt;li&gt;[ ] Binary validation step confirms the artifact actually runs&lt;/li&gt;
&lt;li&gt;[ ] Secrets access scoped to minimum required jobs&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;When you're building automation around the GitHub MCP Server, these patterns keep your CI pipeline from becoming the weakest link in your supply chain.&lt;/p&gt;

</description>
      <category>github</category>
      <category>devops</category>
      <category>ci</category>
      <category>automation</category>
    </item>
    <item>
      <title>Automating SSL Renewals in GitHub Actions with acme.sh</title>
      <dc:creator>Maya Patel</dc:creator>
      <pubDate>Sun, 18 Oct 2026 04:32:35 +0000</pubDate>
      <link>https://dev.to/maya_patel/automating-ssl-renewals-in-github-actions-with-acmesh-1b82</link>
      <guid>https://dev.to/maya_patel/automating-ssl-renewals-in-github-actions-with-acmesh-1b82</guid>
      <description>&lt;h1&gt;
  
  
  Automating SSL Renewals in GitHub Actions with acme.sh
&lt;/h1&gt;

&lt;p&gt;When our infrastructure team inherited a legacy deployment pipeline that required manual SSL certificate renewals every 90 days, the operational debt became unsustainable. After evaluating several ACME clients, we chose &lt;code&gt;acme.sh&lt;/code&gt; for its pure shell implementation and minimal dependencies—critical for containerized CI environments.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Problem: Certificate Expiry as a Production Incident
&lt;/h2&gt;

&lt;p&gt;Our initial approach used cron jobs on individual VMs, but this created blind spots:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;No centralized audit trail of renewal attempts&lt;/li&gt;
&lt;li&gt;Failed renewals went unnoticed until expiry warnings&lt;/li&gt;
&lt;li&gt;Inconsistent acme.sh versions across environments&lt;/li&gt;
&lt;li&gt;Manual intervention required during DNS validation&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;We needed certificate lifecycle management integrated directly into our GitHub Actions deployment pipeline.&lt;/p&gt;

&lt;h2&gt;
  
  
  Deliverable 1: Hardened GitHub Actions Workflow
&lt;/h2&gt;

&lt;p&gt;This workflow runs on a schedule and can be triggered manually. Key hardening techniques:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight yaml"&gt;&lt;code&gt;&lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;SSL Certificate Renewal&lt;/span&gt;

&lt;span class="na"&gt;on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;schedule&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;cron&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;0&lt;/span&gt;&lt;span class="nv"&gt; &lt;/span&gt;&lt;span class="s"&gt;2&lt;/span&gt;&lt;span class="nv"&gt; &lt;/span&gt;&lt;span class="s"&gt;*&lt;/span&gt;&lt;span class="nv"&gt; &lt;/span&gt;&lt;span class="s"&gt;*&lt;/span&gt;&lt;span class="nv"&gt; &lt;/span&gt;&lt;span class="s"&gt;0'&lt;/span&gt;  &lt;span class="c1"&gt;# Weekly Sunday 2 AM UTC&lt;/span&gt;
  &lt;span class="na"&gt;workflow_dispatch&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;

&lt;span class="na"&gt;concurrency&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;group&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;ssl-renewal&lt;/span&gt;
  &lt;span class="na"&gt;cancel-in-progress&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;false&lt;/span&gt;  &lt;span class="c1"&gt;# Never cancel mid-renewal&lt;/span&gt;

&lt;span class="na"&gt;jobs&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
  &lt;span class="na"&gt;renew&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
    &lt;span class="na"&gt;runs-on&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;ubuntu-22.04&lt;/span&gt;
    &lt;span class="na"&gt;timeout-minutes&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="m"&gt;15&lt;/span&gt;

    &lt;span class="na"&gt;strategy&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="na"&gt;matrix&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
        &lt;span class="na"&gt;domain&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="s"&gt;api.example.com&lt;/span&gt;
          &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="s"&gt;app.example.com&lt;/span&gt;
      &lt;span class="na"&gt;fail-fast&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="kc"&gt;false&lt;/span&gt;  &lt;span class="c1"&gt;# Continue other domains on failure&lt;/span&gt;

    &lt;span class="na"&gt;steps&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Checkout acme.sh pinned version&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/checkout@b4ffde65f46336ab88eb53be808477a3936bae11&lt;/span&gt;  &lt;span class="c1"&gt;# v4.1.1&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;repository&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;acmesh-official/acme.sh&lt;/span&gt;
          &lt;span class="na"&gt;ref&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s1"&gt;'&lt;/span&gt;&lt;span class="s"&gt;3.0.7'&lt;/span&gt;  &lt;span class="c1"&gt;# Pin exact release&lt;/span&gt;
          &lt;span class="na"&gt;path&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;acme.sh&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Cache acme.sh account&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/cache@13aacd865c20de90d75de3b17ebe84f7a17d57d2&lt;/span&gt;  &lt;span class="c1"&gt;# v4.0.0&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;path&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;~/.acme.sh&lt;/span&gt;
          &lt;span class="na"&gt;key&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;acme-account-${{ runner.os }}-v2&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Install acme.sh&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;cd acme.sh&lt;/span&gt;
          &lt;span class="s"&gt;./acme.sh --install --nocron --home ~/.acme.sh \&lt;/span&gt;
            &lt;span class="s"&gt;--accountemail ${{ secrets.ACME_EMAIL }}&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Issue certificate with DNS validation&lt;/span&gt;
        &lt;span class="na"&gt;env&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;CF_Token&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ secrets.CLOUDFLARE_API_TOKEN }}&lt;/span&gt;
          &lt;span class="na"&gt;CF_Zone_ID&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;${{ secrets.CLOUDFLARE_ZONE_ID }}&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;~/.acme.sh/acme.sh --issue \&lt;/span&gt;
            &lt;span class="s"&gt;--dns dns_cf \&lt;/span&gt;
            &lt;span class="s"&gt;--domain ${{ matrix.domain }} \&lt;/span&gt;
            &lt;span class="s"&gt;--keylength ec-256 \&lt;/span&gt;
            &lt;span class="s"&gt;--server letsencrypt \&lt;/span&gt;
            &lt;span class="s"&gt;--log ~/.acme.sh/acme.log&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Upload certificate to secrets manager&lt;/span&gt;
        &lt;span class="na"&gt;if&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;success()&lt;/span&gt;
        &lt;span class="na"&gt;run&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="pi"&gt;|&lt;/span&gt;
          &lt;span class="s"&gt;# Example: AWS Secrets Manager&lt;/span&gt;
          &lt;span class="s"&gt;CERT=$(cat ~/.acme.sh/${{ matrix.domain }}_ecc/fullchain.cer | base64 -w0)&lt;/span&gt;
          &lt;span class="s"&gt;KEY=$(cat ~/.acme.sh/${{ matrix.domain }}_ecc/${{ matrix.domain }}.key | base64 -w0)&lt;/span&gt;

          &lt;span class="s"&gt;aws secretsmanager update-secret \&lt;/span&gt;
            &lt;span class="s"&gt;--secret-id "ssl/${{ matrix.domain }}/cert" \&lt;/span&gt;
            &lt;span class="s"&gt;--secret-string "$CERT"&lt;/span&gt;

          &lt;span class="s"&gt;aws secretsmanager update-secret \&lt;/span&gt;
            &lt;span class="s"&gt;--secret-id "ssl/${{ matrix.domain }}/key" \&lt;/span&gt;
            &lt;span class="s"&gt;--secret-string "$KEY"&lt;/span&gt;

      &lt;span class="pi"&gt;-&lt;/span&gt; &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;Upload logs on failure&lt;/span&gt;
        &lt;span class="na"&gt;if&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;failure()&lt;/span&gt;
        &lt;span class="na"&gt;uses&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;actions/upload-artifact@26f96dfa697d77e81fd5907df203aa23a56210a8&lt;/span&gt;  &lt;span class="c1"&gt;# v4.3.0&lt;/span&gt;
        &lt;span class="na"&gt;with&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt;
          &lt;span class="na"&gt;name&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;acme-logs-${{ matrix.domain }}&lt;/span&gt;
          &lt;span class="na"&gt;path&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="s"&gt;~/.acme.sh/acme.log&lt;/span&gt;
          &lt;span class="na"&gt;retention-days&lt;/span&gt;&lt;span class="pi"&gt;:&lt;/span&gt; &lt;span class="m"&gt;30&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  Deliverable 2: Pre-Deployment Validation Script
&lt;/h2&gt;

&lt;p&gt;This bash script runs in CI before deploying certificate updates to production:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="c"&gt;#!/usr/bin/env bash&lt;/span&gt;
&lt;span class="nb"&gt;set&lt;/span&gt; &lt;span class="nt"&gt;-euo&lt;/span&gt; pipefail

&lt;span class="c"&gt;# validate-cert.sh - Run in CI to enforce certificate quality gates&lt;/span&gt;

&lt;span class="nv"&gt;DOMAIN&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$1&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt;
&lt;span class="nv"&gt;CERT_FILE&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$2&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt;

&lt;span class="c"&gt;# Gate 1: Certificate expiry must be &amp;gt; 30 days&lt;/span&gt;
&lt;span class="nv"&gt;EXPIRY&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="si"&gt;$(&lt;/span&gt;openssl x509 &lt;span class="nt"&gt;-enddate&lt;/span&gt; &lt;span class="nt"&gt;-noout&lt;/span&gt; &lt;span class="nt"&gt;-in&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$CERT_FILE&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt; | &lt;span class="nb"&gt;cut&lt;/span&gt; &lt;span class="nt"&gt;-d&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nt"&gt;-f2&lt;/span&gt;&lt;span class="si"&gt;)&lt;/span&gt;
&lt;span class="nv"&gt;EXPIRY_EPOCH&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="si"&gt;$(&lt;/span&gt;&lt;span class="nb"&gt;date&lt;/span&gt; &lt;span class="nt"&gt;-d&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$EXPIRY&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt; +%s&lt;span class="si"&gt;)&lt;/span&gt;
&lt;span class="nv"&gt;NOW_EPOCH&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="si"&gt;$(&lt;/span&gt;&lt;span class="nb"&gt;date&lt;/span&gt; +%s&lt;span class="si"&gt;)&lt;/span&gt;
&lt;span class="nv"&gt;DAYS_REMAINING&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="k"&gt;$((&lt;/span&gt; &lt;span class="o"&gt;(&lt;/span&gt;EXPIRY_EPOCH &lt;span class="o"&gt;-&lt;/span&gt; NOW_EPOCH&lt;span class="o"&gt;)&lt;/span&gt; &lt;span class="o"&gt;/&lt;/span&gt; &lt;span class="m"&gt;86400&lt;/span&gt; &lt;span class="k"&gt;))&lt;/span&gt;

&lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="o"&gt;[[&lt;/span&gt; &lt;span class="nv"&gt;$DAYS_REMAINING&lt;/span&gt; &lt;span class="nt"&gt;-lt&lt;/span&gt; 30 &lt;span class="o"&gt;]]&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="k"&gt;then
  &lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"FAIL: Certificate expires in &lt;/span&gt;&lt;span class="nv"&gt;$DAYS_REMAINING&lt;/span&gt;&lt;span class="s2"&gt; days (minimum 30)"&lt;/span&gt;
  &lt;span class="nb"&gt;exit &lt;/span&gt;1
&lt;span class="k"&gt;fi&lt;/span&gt;

&lt;span class="c"&gt;# Gate 2: Subject Alternative Name must match domain&lt;/span&gt;
&lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="o"&gt;!&lt;/span&gt; openssl x509 &lt;span class="nt"&gt;-noout&lt;/span&gt; &lt;span class="nt"&gt;-text&lt;/span&gt; &lt;span class="nt"&gt;-in&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$CERT_FILE&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt; | &lt;span class="nb"&gt;grep&lt;/span&gt; &lt;span class="nt"&gt;-q&lt;/span&gt; &lt;span class="s2"&gt;"DNS:&lt;/span&gt;&lt;span class="nv"&gt;$DOMAIN&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="k"&gt;then
  &lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"FAIL: Certificate SAN does not include &lt;/span&gt;&lt;span class="nv"&gt;$DOMAIN&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt;
  &lt;span class="nb"&gt;exit &lt;/span&gt;1
&lt;span class="k"&gt;fi&lt;/span&gt;

&lt;span class="c"&gt;# Gate 3: Certificate chain must be complete&lt;/span&gt;
&lt;span class="nv"&gt;CHAIN_DEPTH&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="si"&gt;$(&lt;/span&gt;openssl crl2pkcs7 &lt;span class="nt"&gt;-nocrl&lt;/span&gt; &lt;span class="nt"&gt;-certfile&lt;/span&gt; &lt;span class="s2"&gt;"&lt;/span&gt;&lt;span class="nv"&gt;$CERT_FILE&lt;/span&gt;&lt;span class="s2"&gt;"&lt;/span&gt; | &lt;span class="se"&gt;\&lt;/span&gt;
  openssl pkcs7 &lt;span class="nt"&gt;-print_certs&lt;/span&gt; &lt;span class="nt"&gt;-noout&lt;/span&gt; | &lt;span class="nb"&gt;grep&lt;/span&gt; &lt;span class="nt"&gt;-c&lt;/span&gt; &lt;span class="s2"&gt;"subject="&lt;/span&gt;&lt;span class="si"&gt;)&lt;/span&gt;

&lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="o"&gt;[[&lt;/span&gt; &lt;span class="nv"&gt;$CHAIN_DEPTH&lt;/span&gt; &lt;span class="nt"&gt;-lt&lt;/span&gt; 2 &lt;span class="o"&gt;]]&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="k"&gt;then
  &lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"FAIL: Certificate chain incomplete (depth: &lt;/span&gt;&lt;span class="nv"&gt;$CHAIN_DEPTH&lt;/span&gt;&lt;span class="s2"&gt;)"&lt;/span&gt;
  &lt;span class="nb"&gt;exit &lt;/span&gt;1
&lt;span class="k"&gt;fi

&lt;/span&gt;&lt;span class="nb"&gt;echo&lt;/span&gt; &lt;span class="s2"&gt;"PASS: Certificate valid for &lt;/span&gt;&lt;span class="nv"&gt;$DAYS_REMAINING&lt;/span&gt;&lt;span class="s2"&gt; days with complete chain"&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  War Story: The Unpinned Action Incident
&lt;/h2&gt;

&lt;p&gt;In March 2025, a supply chain compromise in a popular GitHub Action inserted credential exfiltration code. We discovered our runner logs were being uploaded to an external S3 bucket—logs that contained temporary AWS credentials.&lt;/p&gt;

&lt;p&gt;The root cause: unpinned action versions using &lt;code&gt;@main&lt;/code&gt; tags. After incident response, we implemented two policies:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Pin all actions to full commit SHAs&lt;/strong&gt; (not tags, which are mutable)&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Weekly Dependabot PRs&lt;/strong&gt; to update pinned SHAs with security review&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  Lessons from Production
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;Concurrency control matters.&lt;/strong&gt; Early versions allowed parallel renewal jobs, which triggered Let's Encrypt rate limits. The &lt;code&gt;cancel-in-progress: false&lt;/code&gt; directive prevents workflow cancellations mid-validation.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Cache keys must version-bump on breaking changes.&lt;/strong&gt; When we migrated from RSA to ECDSA certificates, stale cached account data caused validation failures. Explicit cache versioning (&lt;code&gt;-v2&lt;/code&gt; suffix) gives us a manual invalidation lever.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Matrix builds isolate blast radius.&lt;/strong&gt; With &lt;code&gt;fail-fast: false&lt;/code&gt;, a failure renewing one domain doesn't block others. The tradeoff: longer wall-clock time, but acceptable for weekly runs.&lt;/p&gt;

&lt;h2&gt;
  
  
  Conclusion
&lt;/h2&gt;

&lt;p&gt;Integrating acme.sh into GitHub Actions eliminated an entire class of operational incidents. The workflow runs unattended, with Slack notifications on failure and certificate metrics exported to our observability stack.&lt;/p&gt;

&lt;p&gt;The full validation script and workflow are production-tested across 40+ domains handling 2M+ requests daily. Certificate expiry hasn't triggered a page in 18 months.&lt;/p&gt;

</description>
      <category>github</category>
      <category>devops</category>
      <category>ci</category>
      <category>automation</category>
    </item>
  </channel>
</rss>
