The latest articles on DEV Community by Mzeeshan127 (@mzeeshan127). https://dev.to/mzeeshan127 https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4157237%2F32fdac35-e3f7-4051-b4fa-02fcc1d1a803.png https://dev.to/mzeeshan127 en Mzeeshan127 Fri, 02 Oct 2026 12:20:51 +0000 https://dev.to/mzeeshan127/can-gpt-54-mini-handle-least-privilege-cloud-incidents-a-16-case-benchmark-428i https://dev.to/mzeeshan127/can-gpt-54-mini-handle-least-privilege-cloud-incidents-a-16-case-benchmark-428i <p><em>This is a submission for the <a href="https://dev.to/challenges/kaggle-2026-09-23">Kaggle Benchmarking Challenge</a></em></p> <h2> What I Benchmarked </h2> <p>I built a small decision benchmark for cloud operations and incident response. It presents 16 fully synthetic situations involving exposed credentials, access scope, suspicious accounts, evidence preservation, risky commands, storage exposure, firewall changes, and approval boundaries. Each case expects one documented action identifier; scoring is exact match. I was interested in whether models could choose a safe, proportionate action while respecting least privilege and approval boundaries.</p> <p>No cloud APIs, production infrastructure, real credentials, or customer data are used.</p> <h2> Models Tested </h2> <p>I ran OpenAI GPT-5.4 mini (Kaggle model listing: GPT-5.4 mini) against the task. I started with a single model to establish a reproducible baseline; additional candidates were not successfully evaluated in this run, so this is not a model-to-model comparison.</p> <h2> Findings </h2> <p>GPT-5.4 mini scored <strong>75.0% (12/16)</strong> exact-match accuracy on the fixed set, evaluated October 2, 2026. That means four choices did not match the reference action identifiers. The aggregate score does not show which case types caused those mismatches, so I cannot responsibly infer a specific weakness from this run. The next step is to inspect per-case outcomes and run a broader model lineup under the same task conditions.</p> <p>This is a small, fixed synthetic set, not evidence of real-world security competence, reasoning quality, calibration, or performance on live incidents.</p> <h2> My Benchmark </h2> <p><a href="https://www.kaggle.com/benchmarks/zeeshan1271/least-privilege-cloud-operations" rel="noopener noreferrer">Least-Privilege Cloud Operations on Kaggle</a></p> <p>The public benchmark includes the task, scoring description, and recorded result.</p> <p>AI tools assisted with parts of preparing this benchmark and submission.</p> devchallenge kagglechallenge ai machinelearning