DEV Community

Patrick Hughes profile picture

Patrick Hughes

404 bio not found

Joined Joined on  github website
Ollama num_batch: 256 Was My RTX 5090 Sweet Spot
pat9000 profile

Ollama num_batch: 256 Was My RTX 5090 Sweet Spot

#localai #ollama #localllm #rtx5090
Comments
4 min read

Want to connect with Patrick Hughes?

Create an account to connect with Patrick Hughes. You can also sign in below to proceed if you already have an account.

Create Account
Already have an account? Sign in
A 7 GB 27B Model Lost to My 17 GB Default
pat9000 profile

A 7 GB 27B Model Lost to My 17 GB Default

#localai #localllm #gguf #modelselection
1
Comments
5 min read
My Agents Have to Prove What They Did
pat9000 profile

My Agents Have to Prove What They Did

#aiagents #agentinfrastructure #showwork #localai
Comments 1
4 min read
Your Agent's Audit Trail Cannot Be Retrofitted
pat9000 profile

Your Agent's Audit Trail Cannot Be Retrofitted

#aiagents #agentverification #showwork #euaiact
Comments
5 min read
Ollama Raised $65M. What Builders Get
pat9000 profile

Ollama Raised $65M. What Builders Get

#localai #localllm #ollama #ownedhardware
1
Comments
5 min read
Why production AI is moving to open weights
pat9000 profile

Why production AI is moving to open weights

#localllm #openmodels #rtx5090 #aiinfrastructure
Comments
4 min read
Devlog 2026-07-13: local drive git corruption stalls the q
pat9000 profile

Devlog 2026-07-13: local drive git corruption stalls the q

#devlog #daily #bmdhodl
Comments
3 min read
My 8B Model Failed a 400-Word Task
pat9000 profile

My 8B Model Failed a 400-Word Task

#localllm #modelselection #ollama #rtx5090
Comments
5 min read
Q4km vs Q5km: Q4_K_M vs Q5_K_M
pat9000 profile

Q4km vs Q5km: Q4_K_M vs Q5_K_M

#localllm #gguf #quantization #llamacpp
Comments
3 min read
I Rebuilt 5,383 Embeddings After a Dimension Change
pat9000 profile

I Rebuilt 5,383 Embeddings After a Dimension Change

#localllm #embeddings #vectorsearch #ollama
Comments
5 min read
I Raised the QA Bar on Blog Infographics
pat9000 profile

I Raised the QA Bar on Blog Infographics

#localllm #5090reports #blog #matplotlib
Comments
4 min read
Pin Your Context Window or Pay the Reload Tax
pat9000 profile

Pin Your Context Window or Pay the Reload Tax

#localllm #ollama #numctx #localaiagents
Comments
5 min read
Preview Retrieval Before Your Local LLM Runs
pat9000 profile

Preview Retrieval Before Your Local LLM Runs

#localllm #retrieval #localaiagents #privateai
Comments
5 min read
Pin Your Local LLM Context Size Before You Build a Router
pat9000 profile

Pin Your Local LLM Context Size Before You Build a Router

#localllm #modelrouting #ollama #rtx5090
Comments
4 min read
When Claude hits a weekly limit, your agent fleet still needs a third CLI
pat9000 profile

When Claude hits a weekly limit, your agent fleet still needs a third CLI

#localllm #aiagents #gemini #agentops
Comments
4 min read
I built a self-improving code model on one RTX 5090. Here is what actually worked.
pat9000 profile

I built a self-improving code model on one RTX 5090. Here is what actually worked.

#localllm #aiagents #finetuning #rtx5090
Comments
5 min read
Will That Local Model Fit? Do the VRAM Math First
pat9000 profile

Will That Local Model Fit? Do the VRAM Math First

#localllm #vram #quantization #llamacpp
Comments
5 min read
Local LLMs Need a Timeout Before They Need a Bigger Model
pat9000 profile

Local LLMs Need a Timeout Before They Need a Bigger Model

#localai #ollama #5090reports #aiagents
Comments
5 min read
Your local LLM is not a worse Claude. It is a different tool.
pat9000 profile

Your local LLM is not a worse Claude. It is a different tool.

#localllm #openweights #aiagents #agentguard
Comments
5 min read
How I Gate a Local Coding Model Before I Trust It
pat9000 profile

How I Gate a Local Coding Model Before I Trust It

#localai #5090reports #ollama #codingagents
Comments
5 min read
A verifier loop beats a faster local model
pat9000 profile

A verifier loop beats a faster local model

#localai #localllm #5090reports #agentguard
Comments
4 min read
How I Make Local Model Runs Fail Safely On A 5090
pat9000 profile

How I Make Local Model Runs Fail Safely On A 5090

#localai #rtx5090 #qlora #localllm
Comments
5 min read
How to Make a Local QLoRA Starter Fail Safely
pat9000 profile

How to Make a Local QLoRA Starter Fail Safely

#localai #qlora #rtx5090 #finetuning
Comments
5 min read
Use Owner Gates and AgentGuard to Keep AI Agents Moving
pat9000 profile

Use Owner Gates and AgentGuard to Keep AI Agents Moving

#aiagents #agentops #asyncworkflows #onepersoncompany
Comments
5 min read
How to Run Local LLM Verifier Loops on Owned Hardware
pat9000 profile

How to Run Local LLM Verifier Loops on Owned Hardware

#localllm #aiagents #verifierloops #llamacpp
Comments
5 min read
AI Agent Memory: What Actually Works in 2026
pat9000 profile

AI Agent Memory: What Actually Works in 2026

#aiagents #memory #agentops #onepersoncompany
Comments
4 min read
What Anthropic's MITRE ATT&CK report means for solo AI builders
pat9000 profile

What Anthropic's MITRE ATT&CK report means for solo AI builders

#aisecurity #agents #anthropic #agentguard
Comments
4 min read
AI Agent Memory in 2026: How It Works and When to Use It
pat9000 profile

AI Agent Memory in 2026: How It Works and When to Use It

#aiagents #memory #localllms #agentarchitecture
Comments 1
2 min read
Your AI Agent Says "Done." Make It Prove It.
pat9000 profile

Your AI Agent Says "Done." Make It Prove It.

#aiagents #agentops #verification #onepersoncompany
2
Comments 2
4 min read
Give Your AI Agents an Append-Only Event Log
pat9000 profile

Give Your AI Agents an Append-Only Event Log

#aiagents #observability #eventsourcing #onepersoncompany
1
Comments
4 min read
A self-healing system can't heal an empty queue
pat9000 profile

A self-healing system can't heal an empty queue

#aiagents #automation #monitoring #selfhealing
Comments
4 min read
Missing AI agent cost data is not zero
pat9000 profile

Missing AI agent cost data is not zero

#aiagents #costcontrol #observability #spendtracking
Comments 1
4 min read
Anthropic Writes 80% of Its Code with Claude
pat9000 profile

Anthropic Writes 80% of Its Code with Claude

#ai #solobuilder #coding
Comments
2 min read
What Salesforce's 20,000 AI Agent Deployments Teach a Solo Builder
pat9000 profile

What Salesforce's 20,000 AI Agent Deployments Teach a Solo Builder

#aiagents #agentdeployment #agentreliability #agentguard
Comments 2
4 min read
57-71% of AI agents leak data between users. Here's what to do.
pat9000 profile

57-71% of AI agents leak data between users. Here's what to do.

#aiagents #security #agentmemory #agentguard
Comments
3 min read
VRAM Calculator: Estimate Local LLM Requirements
pat9000 profile

VRAM Calculator: Estimate Local LLM Requirements

#localllm #hardware #vram #llama3
Comments
1 min read
Anthropic's IPO and the 40% Cost-Savings Gap: Why Your Spend Cap Matters More Now
pat9000 profile

Anthropic's IPO and the 40% Cost-Savings Gap: Why Your Spend Cap Matters More Now

#aiagents #costcontrol #anthropic #agentguard
Comments
4 min read
When JPMorgan's AI bill goes up, who controls it?
pat9000 profile

When JPMorgan's AI bill goes up, who controls it?

#aiagents #enterpriseai #costcontrol #agentguard
Comments
4 min read
57-71% of AI Agents Leak Data Between Users. Here's the Fix.
pat9000 profile

57-71% of AI Agents Leak Data Between Users. Here's the Fix.

#aiagents #security #agentmemory #agentguard
Comments
4 min read
AI Coding Assistant Pricing in 2026: Copilot vs Cursor vs Claude Code
pat9000 profile

AI Coding Assistant Pricing in 2026: Copilot vs Cursor vs Claude Code

#aicoding #pricing #developertools #costcontrol
Comments
3 min read
How to Close the AI Agent Cost Gap at the Call Site
pat9000 profile

How to Close the AI Agent Cost Gap at the Call Site

#aiagents #costcontrol #agentguard #python
Comments
4 min read
Agentic coding moved my bottleneck to code review
pat9000 profile

Agentic coding moved my bottleneck to code review

#agenticcoding #aiagents #solodev #codereview
Comments
3 min read
How to Pick a GGUF Quant Level for Your VRAM Budget
pat9000 profile

How to Pick a GGUF Quant Level for Your VRAM Budget

#localllm #gguf #quantization #gpu
Comments
4 min read
Stop Telling People You Have 11 AI Agents
pat9000 profile

Stop Telling People You Have 11 AI Agents

#aiagents #onepersonops #agentcost #agentguard
Comments
4 min read
GGUF Quantization and VRAM: How to Pick Q4, Q5, or Q8 for Your GPU (2026)
pat9000 profile

GGUF Quantization and VRAM: How to Pick Q4, Q5, or Q8 for Your GPU (2026)

#localllm #gguf #quantization #llamacpp
Comments
4 min read
Your AI agent doesn't need memory. It needs a file.
pat9000 profile

Your AI agent doesn't need memory. It needs a file.

#aiagents #onepersonops #agentmemory #agentguard
1
Comments
4 min read
How to Tune llama.cpp --n-gpu-layers: A Practical VRAM Guide (2026)
pat9000 profile

How to Tune llama.cpp --n-gpu-layers: A Practical VRAM Guide (2026)

#localllm #llamacpp #gpu #vram
Comments
4 min read
Which GGUF Quant Should You Actually Pick? Q4 vs Q5 vs Q6 vs Q8 (2026)
pat9000 profile

Which GGUF Quant Should You Actually Pick? Q4 vs Q5 vs Q6 vs Q8 (2026)

#localllm #gguf #quantization #gpu
Comments
4 min read
How to Tune --n-gpu-layers for Your VRAM Budget
pat9000 profile

How to Tune --n-gpu-layers for Your VRAM Budget

#localllm #llamacpp #gpu #vram
Comments
4 min read
llama.cpp Multi-GPU: Splitting a Model Across Cards with --tensor-split
pat9000 profile

llama.cpp Multi-GPU: Splitting a Model Across Cards with --tensor-split

#llamacpp #localllm #gpu #multigpu
Comments
5 min read
What Uber's $1,500/Developer AI Cap Tells You About Your Own Bill
pat9000 profile

What Uber's $1,500/Developer AI Cap Tells You About Your Own Bill

#aicostcontrol #agentguard #claudecode #runtimegovernance
Comments
4 min read
Your AI Agent's Retry Loop Is a Cost Bug Waiting to Happen
pat9000 profile

Your AI Agent's Retry Loop Is a Cost Bug Waiting to Happen

#aiagents #costcontrol #agentguard
Comments
3 min read
When JPMorgan Turns On AI Bank-Wide, Who Controls the Bill?
pat9000 profile

When JPMorgan Turns On AI Bank-Wide, Who Controls the Bill?

#aiagents #enterpriseai #costcontrol #agentguard
Comments
4 min read
What Anthropic's MITRE ATT&CK Report Means for Teams Running AI Agents
pat9000 profile

What Anthropic's MITRE ATT&CK Report Means for Teams Running AI Agents

#aisecurity #agents #anthropic #agentguard
Comments
4 min read
What GitHub Copilot Users Wish They Had a Week Ago
pat9000 profile

What GitHub Copilot Users Wish They Had a Week Ago

#aiagents #costcontrol #githubcopilot #agentguard
Comments
3 min read
When Not to Use an AI Agent
pat9000 profile

When Not to Use an AI Agent

#aiagents #agentguard #automation
Comments
3 min read
llama.cpp ngl: when -ngl 99 still runs on your CPU
pat9000 profile

llama.cpp ngl: when -ngl 99 still runs on your CPU

#llamacpp #localllm #gpuoffloading #ngpulayers
1
Comments
5 min read
I made my blog API reject its own writer
pat9000 profile

I made my blog API reject its own writer

#agenticcoding #aiagentops #apidesign #qualitygates
Comments
4 min read
When Your Blog Repair Loop Fails 23 Times, Stop Repairing
pat9000 profile

When Your Blog Repair Loop Fails 23 Times, Stop Repairing

#agents #agentguard #devlog
Comments
3 min read
Your Cron Jobs Lie - Why I Built an Outcome Checker
pat9000 profile

Your Cron Jobs Lie - Why I Built an Outcome Checker

#aiagents #automation #monitoring
1
Comments
4 min read
loading...