DEV Community: Query Filter

docker43

Query Filter — Fri, 17 Apr 2026 15:50:12 +0000

# ------------------------------------------------------------------------------------------
# BUILD IDENTIFICATION SUMMARY:
# The 'lightspeed.build_version' acts as the unique identifier for the build artifact bundle.
# It is used to locate the manifest.json and the RPM within Artifactory.
#
# Path breakdown based on: .../{{ build_version }}/ansible/{{ rpm_name }}
#
# 1. BUILD VERSION: 199-cc1c553-leonid-comet-lse-migration
#    - Format: [Build Number]-[Git Commit]-[Branch Name]
#    - Purpose: Unique folder key for the entire build architecture.
#
# 2. APPLICATION: CPLS
#    - Extracted from the RPM prefix.
#
# 3. GRADLE BUILD VERSION (Software Version): 1.7.6
#    - Extracted from the RPM version string.
#
# 4. ARCHITECTURE: x86_64
#    - Target CPU architecture.
#
# 5. GIT METADATA:
#    - Branch: leonid-comet-lse-migration
#    - Commit: cc1c553
#    - Build Number: 199
# ------------------------------------------------------------------------------------------

docker42

Query Filter — Thu, 16 Apr 2026 14:00:10 +0000

- name: "Install: Unpack RPM via Built-in Shell (Fallback) #noqa: fqcn[action-core] command-shell"
  vars:
    pkg_manager: "/usr/bin/yum"
  ansible.builtin.shell: "sudo -n {{ pkg_manager }} install -y {{ found_rpms.files[0].path }} --allowerasing --nogpgcheck"
  args:
    warn: false
  become: no
  register: rpm_install_status

docker40

Query Filter — Wed, 15 Apr 2026 17:33:30 +0000

- name: "Ensure correct ownership for downloaded artifacts"
  ansible.builtin.file:
    path: "{{ openshift_temp_dir.temp_dir }}/{{ lightspeed.build_version }}"
    owner: cometgran
    group: comet
    recurse: yes  # Это применит права и к папке, и ко всем файлам внутри (RPM и манифесту)

====================

---
- name: Install COMET
  hosts: all
  gather_facts: true
  become: yes

  tasks:
    - name: "Step 1: Run Discovery and Manual Download"
      include_role:
        name: discovery

    - name: "Step 2: Run standard download (Only if explicitly requested)"
      include_role:
        name: artifacts_download_v1
      # Роль запустится ТОЛЬКО если вы передадите переменную run_standard=true
      # В остальное время она будет пропущена (skipped).
      when: run_standard | default(false)

    - name: "Step 3: Proceed with CPLS deployment"
      include_role:
        name: rpm_deployment

docker43

Query Filter — Tue, 14 Apr 2026 19:21:48 +0000

- name: "Read and Parse Manifest"
  ansible.builtin.set_fact:
    manifest_data: "{{ lookup('file', openshift_temp_dir.temp_dir + '/' + lightspeed.build_version + '/manifest.json') | from_json }}"

- name: "Debug: Show a value from manifest"
  ansible.builtin.debug:
    msg: "The build timestamp is {{ manifest_data.timestamp }}" # Замените на реальное поле из вашего JSON

docker42

Query Filter — Tue, 14 Apr 2026 18:06:11 +0000

- name: "Manual Download: Fetch manifest.json from Artifactory"
  ansible.builtin.get_url:
    # Используем точный путь к артефактам из объекта lightspeed
    url: "{{ lightspeed.artifactory.build_artifacts_url }}/manifest.json"
    # Сохраняем в динамическую директорию, где уже находится RPM
    dest: "{{ openshift_temp_dir.temp_dir }}/{{ lightspeed.build_version }}/manifest.json"
    # Аутентификация через найденные в дампе учетные данные
    url_username: "{{ lightspeed.artifactory.username }}"
    url_password: "{{ lightspeed.artifactory.password }}"
    mode: '0755'
    validate_certs: no
  register: download_manifest

- name: "Discovery: Find RPM and Manifest"
  ansible.builtin.find:
    paths: "{{ openshift_temp_dir.temp_dir }}/{{ lightspeed.build_version }}"
    patterns: 
      - "*.rpm"
      - "manifest.json"
  register: found_artifacts

- name: "Report Discovered Files"
  ansible.builtin.debug:
    msg: 
      - "Search Path: {{ openshift_temp_dir.temp_dir }}/{{ lightspeed.build_version }}"
      - "Files Found: {{ found_artifacts.matched }}"
      - "Details: {{ found_artifacts.files | map(attribute='path') | list }}"

- name: "Fail if manifest is missing"
  ansible.builtin.fail:
    msg: "Critical artifact (manifest.json) was not found after manual download attempt."
  when: found_artifacts.matched < 2

docker41

Query Filter — Tue, 14 Apr 2026 17:59:38 +0000

- name: "Manual Download: Fetch manifest.json from Artifactory"
  ansible.builtin.get_url:
    # Собираем URL: берем базовый путь и меняем хвост на manifest.json
    url: "https://www.malrepository.../ansible/manifest.json" 
    dest: "{{ openshift_temp_dir.temp_dir }}/{{ lightspeed.build_version }/manifest.json"
    url_username: "{{ lightspeed.artifactory.username }}"
    url_password: "{{ lightspeed.artifactory.password }}"
    mode: '0755'
    validate_certs: no
  register: download_manifest

docker40

Query Filter — Tue, 14 Apr 2026 17:20:50 +0000

- name: "DEBUG: Dump all Ansible variables"
  ansible.builtin.debug:
    msg: "{{ hostvars[inventory_hostname] }}"
  ignore_errors: yes

docker39

Query Filter — Tue, 14 Apr 2026 16:52:52 +0000

- name: "Discovery: Find RPM and Manifest"
  ansible.builtin.find:
    paths: "{{ openshift_temp_dir.temp_dir }}/{{ lightspeed.build_version }}"
    patterns: 
      - "*.rpm"
      - "manifest.json"
  register: found_artifacts

- name: "Report Discovered Files"
  ansible.builtin.debug:
    msg: 
      - "Search Path: {{ openshift_temp_dir.temp_dir }}/{{ lightspeed.build_version }}"
      - "Files Found (Count): {{ found_artifacts.matched }}"
      - "Details: {{ found_artifacts.files | map(attribute='path') | list }}"

- name: "Fail if manifest is missing"
  ansible.builtin.fail:
    msg: |
      Error: Missing artifacts!
      Expected: at least an RPM and a manifest.json.
      Found: {{ found_artifacts.matched }} files.
      Checked path: {{ openshift_temp_dir.temp_dir }}/{{ lightspeed.build_version }}
  when: found_artifacts.matched < 2

docker38

Query Filter — Mon, 13 Apr 2026 22:18:20 +0000

1. Discovery: Scan target /tmp directory for existing Qfit*.rpm artifacts.

2. Resolution:

- If found: Extract versioning from the local file to trigger a fresh re-install of that specific build from Artifactory.

- If not found: Use the default artifact naming convention paired with the provided BUILD_VERSION.

3. Staging: Download the resolved artifact from Artifactory to the /tmp staging area.

4. Cleanup: The staging area is purged post-deployment (handled in deployment *.yaml).

docker37

Query Filter — Mon, 13 Apr 2026 21:10:19 +0000

Got it — let’s restart clean and design this properly, without overengineering.

This is a simple, robust hybrid model that is easy to explain, implement, and scale.

🚀 Hybrid RPM Deployment Model (Clean Design)

🎯 Core Idea

We use BUILD_NUMBER as the only shared identifier across all systems.

Everything else is derived from it.

🔄 End-to-End Flow

Tekton (Build Stage)
   │
   ├── builds RPM
   ├── generates manifest.json
   ├── uploads BOTH to Artifactory under BUILD_NUMBER
   └── outputs BUILD_NUMBER
        │
        ▼
Harness (Orchestration)
   │
   ├── receives BUILD_NUMBER
   ├── downloads manifest.json from Artifactory
   ├── extracts rpm_name
   └── passes rpm_name to Ansible
        │
        ▼
Ansible (Deployment)
   │
   ├── uses rpm_name
   └── downloads RPM from Artifactory
   └── installs / upgrades

📦 Artifactory Layout (IMPORTANT)

Each build is isolated:

/artifactory/repo/my-app/
    └── 111-7cf39ab-leonid-comet/
        ├── manifest.json
        └── my-app-1.2.3.rpm

👉 Key rule: BUILD_NUMBER is the folder key

🧾 Manifest Contract

Example `manifest.json`

{
  "build_number": "111-7cf39ab-leonid-comet",
  "rpm_name": "my-app-1.2.3.rpm",
  "branch": "leonid-comet",
  "git_commit": "7cf39ab"
}

🏗️ Tekton + Gradle Stage

1. Build RPM

./gradlew buildRpm

2. Generate manifest (Gradle task)

task generateManifest {
    doLast {
        def buildNumber = System.getenv("BUILD_NUMBER")
        def rpmName = "${project.name}-${version}.rpm"

        def manifest = [
            build_number: buildNumber,
            rpm_name: rpmName,
            branch: buildNumber.split('-').last(),
            git_commit: buildNumber.split('-')[1]
        ]

        file("${buildDir}/manifest.json").text =
            groovy.json.JsonOutput.prettyPrint(
                groovy.json.JsonOutput.toJson(manifest)
            )
    }
}

3. Upload to Artifactory

curl -u user:pass -T build/my-app-1.2.3.rpm \
  "https://artifactory/repo/my-app/${BUILD_NUMBER}/"

curl -u user:pass -T build/manifest.json \
  "https://artifactory/repo/my-app/${BUILD_NUMBER}/"

4. Output build number (Tekton result)

echo "$BUILD_NUMBER" > $(results.build_number.path)

⚙️ Harness Stage

1. Receive build number

- set_fact:
    build_number: "{{ lookup('env', 'BUILD_NUMBER') }}"

2. Download manifest

- name: Fetch manifest
  get_url:
    url: "https://artifactory/repo/my-app/{{ build_number }}/manifest.json"
    dest: /tmp/manifest.json

3. Parse manifest

- set_fact:
    manifest: "{{ lookup('file', '/tmp/manifest.json') | from_json }}"

4. Extract RPM name

- set_fact:
    rpm_name: "{{ manifest.rpm_name }}"

🧰 Ansible Stage

1. Download RPM

- name: Download RPM
  get_url:
    url: "https://artifactory/repo/my-app/{{ build_number }}/{{ rpm_name }}"
    dest: "/tmp/{{ rpm_name }}"

2. Install RPM

- name: Install package
  command: rpm -Uvh /tmp/{{ rpm_name }}

🧠 Why this design works

✅ 1. Fully deterministic

Everything is tied to:

BUILD_NUMBER

No guessing. No regex. No “latest”.

✅ 2. Safe for parallel builds

Each run is isolated:

111-xxx/
112-yyy/
113-zzz/

No collisions possible.

✅ 3. Clean separation of responsibilities

System	Responsibility
Tekton	Build + publish artifacts
Artifactory	Source of truth
Harness	orchestration
Ansible	deployment only

✅ 4. Easy rollback

Just redeploy:

BUILD_NUMBER = previous value

✅ 5. No tight coupling between tools

Ansible never knows:

how RPM is named
how build was created
how Gradle works

🚫 What this avoids

❌ hardcoded filenames
❌ wildcard searching in Artifactory
❌ shared “latest” directories
❌ pipeline-dependent variables everywhere

🎯 Final architecture statement (for team discussion)

We standardize on BUILD_NUMBER as the single global artifact key.
Each build publishes a self-contained manifest and RPM into Artifactory under this key.
Deployment stages resolve artifacts strictly via the manifest, ensuring deterministic, concurrent-safe, and fully reproducible deployments.

docker36

Query Filter — Mon, 13 Apr 2026 17:20:00 +0000

#!/bin/bash

ZIP_FILE="logs.zip"
OUTPUT_FILE="concatenated_logs.txt"

# Clear the output file if it exists
> "$OUTPUT_FILE"

# 1. List files in the zip (-Z1 gives a clean list of paths)
# 2. Use -r to handle backslashes or special characters in names
unzip -Z1 "$ZIP_FILE" | while read -r FILE_PATH; do

    # Skip directories (paths ending in /)
    if [[ "$FILE_PATH" == */ ]]; then
        continue
    fi

    echo "Processing: $FILE_PATH"

    # Add a clear, identifiable header to the output file
    echo -e "\n\n" >> "$OUTPUT_FILE"
    echo "================================================================================" >> "$OUTPUT_FILE"
    echo " SOURCE FILE: $FILE_PATH" >> "$OUTPUT_FILE"
    echo "================================================================================" >> "$OUTPUT_FILE"
    echo -e "\n" >> "$OUTPUT_FILE"

    # Extract the content of the specific file and append to the big file
    # -p (pipe) sends the file content to stdout, bypassing Windows path length limits
    unzip -p "$ZIP_FILE" "$FILE_PATH" >> "$OUTPUT_FILE"

done

echo "---"
echo "Done! All files concatenated into: $OUTPUT_FILE"

docker35

Query Filter — Mon, 13 Apr 2026 16:56:44 +0000

- name: "RPM Promotion Logic"
  hosts: all
  vars:
    # Assuming this was set in your previous task
    discovered_version: "111-7cf39ab-leonid-comet-lse-migration"

  tasks:
    - name: "Step 1: Parse the branch name"
      set_fact:
        branch_name: "{{ discovered_version.split('-')[2:] | join('-') }}"

    - name: "Step 2: Locate the specific RPM"
      find:
        paths: "/tmp"
        # This will look for: *-leonid-comet-lse-migration.rpm
        patterns: "*-{{ branch_name }}.rpm"
      register: rpm_search

    - name: "Step 3: Use the found path for promotion"
      set_fact:
        target_rpm_path: "{{ rpm_search.files[0].path }}"
      when: rpm_search.matched > 0

    - name: "Debug Output"
      debug:
        msg: "Ready to promote: {{ target_rpm_path | default('No file found') }}"

DEV Community: Query Filter

docker43

docker42

docker40

docker43

docker42

docker41

docker40

docker39

docker38

1. Discovery: Scan target /tmp directory for existing Qfit*.rpm artifacts.

2. Resolution:

- If found: Extract versioning from the local file to trigger a fresh re-install of that specific build from Artifactory.

- If not found: Use the default artifact naming convention paired with the provided BUILD_VERSION.

3. Staging: Download the resolved artifact from Artifactory to the /tmp staging area.

4. Cleanup: The staging area is purged post-deployment (handled in deployment *.yaml).

docker37

🚀 Hybrid RPM Deployment Model (Clean Design)

🎯 Core Idea

🔄 End-to-End Flow

📦 Artifactory Layout (IMPORTANT)

🧾 Manifest Contract

Example manifest.json

🏗️ Tekton + Gradle Stage

1. Build RPM

2. Generate manifest (Gradle task)

3. Upload to Artifactory

4. Output build number (Tekton result)

⚙️ Harness Stage

1. Receive build number

2. Download manifest

3. Parse manifest

4. Extract RPM name

🧰 Ansible Stage

1. Download RPM

2. Install RPM

🧠 Why this design works

✅ 1. Fully deterministic

✅ 2. Safe for parallel builds

✅ 3. Clean separation of responsibilities

✅ 4. Easy rollback

✅ 5. No tight coupling between tools

🚫 What this avoids

🎯 Final architecture statement (for team discussion)

docker36

docker35

Example `manifest.json`