Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
Huge Files, No Waiting Series' Articles
Back to y4u's Series
I benchmarked my log viewer against klogg at 3/10/48 GB — the second open is the real win
y4u
y4u
y4u
Follow
Jul 24
I benchmarked my log viewer against klogg at 3/10/48 GB — the second open is the real win
#
showdev
#
performance
#
dotnet
#
devops
Comments
Add Comment
4 min read
I Opened 51GB / 890M Lines of Real Data — Then Calculated How Far It Could Theoretically Go (~9.2 Quintillion Lines)
y4u
y4u
y4u
Follow
Jul 27
I Opened 51GB / 890M Lines of Real Data — Then Calculated How Far It Could Theoretically Go (~9.2 Quintillion Lines)
#
showdev
#
performance
#
opensource
#
uwview
Comments
Add Comment
8 min read
How much slower is the browser build, really? — UwView native (UVF) vs WASM, measured on the same file
y4u
y4u
y4u
Follow
Jul 27
How much slower is the browser build, really? — UwView native (UVF) vs WASM, measured on the same file
#
showdev
#
webassembly
#
browser
#
uwview
Comments
Add Comment
3 min read
Why We Split Search Results Into a Separate Window — Jump, Save, and Context Lines You Can Use \"While Looking\" With the Filter Popup
y4u
y4u
y4u
Follow
Jul 27
Why We Split Search Results Into a Separate Window — Jump, Save, and Context Lines You Can Use \"While Looking\" With the Filter Popup
#
showdev
#
avalonia
#
uwview
#
syslog
Comments
Add Comment
4 min read
I Expanded the Entire US OpenStreetMap to a Single 258 GB XML File — 4,509,830,821 Lines, and What Broke
y4u
y4u
y4u
Follow
Aug 1
I Expanded the Entire US OpenStreetMap to a Single 258 GB XML File — 4,509,830,821 Lines, and What Broke
Comments
Add Comment
5 min read
Shelve an Investigated Log at 1/9th the Size, Reopen It Tomorrow Right Where You Left Off
y4u
y4u
y4u
Follow
Aug 5
Shelve an Investigated Log at 1/9th the Size, Reopen It Tomorrow Right Where You Left Off
Comments
Add Comment
4 min read
I Rebuilt My 30-Year-Old Text Viewer in C#/Avalonia — It Matched the Industry-Standard klogg. Then I Redesigned It for Today's Hardware.
y4u
y4u
y4u
Follow
Aug 8
I Rebuilt My 30-Year-Old Text Viewer in C#/Avalonia — It Matched the Industry-Standard klogg. Then I Redesigned It for Today's Hardware.
Comments
Add Comment
6 min read
Reading Huge Logs by Color — a Highlighter That Doesn't Stutter at 100 Million Lines
y4u
y4u
y4u
Follow
Aug 11
Reading Huge Logs by Color — a Highlighter That Doesn't Stutter at 100 Million Lines
Comments
Add Comment
4 min read
How Many Search Threads Is the Right Number? I Measured 0.89 Billion Lines at 1-16 Threads
y4u
y4u
y4u
Follow
Aug 14
How Many Search Threads Is the Right Number? I Measured 0.89 Billion Lines at 1-16 Threads
Comments
Add Comment
3 min read
My Fanless Mac Skewed My Benchmark by 54% — Thermal Throttling and Round-Robin Measurement
y4u
y4u
y4u
Follow
Aug 14
My Fanless Mac Skewed My Benchmark by 54% — Thermal Throttling and Round-Robin Measurement
#
hardware
#
performance
#
programming
Comments
Add Comment
4 min read
"File Too Large to Open" — Investigating a 50 GB Log Without Splitting It
y4u
y4u
y4u
Follow
Aug 24
"File Too Large to Open" — Investigating a 50 GB Log Without Splitting It
#
devops
#
debugging
#
productivity
#
tools
Comments
Add Comment
2 min read
You Found the ERROR. The Cause Is in the Lines Before It
y4u
y4u
y4u
Follow
Aug 24
You Found the ERROR. The Cause Is in the Lines Before It
#
debugging
#
devops
#
logging
#
tools
Comments
Add Comment
3 min read
I Benchmarked My Free Viewer Against EmEditor and klogg — Honestly
y4u
y4u
y4u
Follow
Aug 24
I Benchmarked My Free Viewer Against EmEditor and klogg — Honestly
#
showdev
#
benchmark
#
opensource
#
performance
Comments
Add Comment
2 min read
How to Open a 50GB Log File — and Reopen It in 0.05 Seconds. A klogg Alternative, Benchmarked
y4u
y4u
y4u
Follow
Aug 29
How to Open a 50GB Log File — and Reopen It in 0.05 Seconds. A klogg Alternative, Benchmarked
#
showdev
#
performance
#
productivity
#
linux
3
reactions
Comments
2
comments
7 min read
This File Is Too Large to Open — Four Go-To Tools That Sink Under Huge Files, and What Comes Next
y4u
y4u
y4u
Follow
Aug 30
This File Is Too Large to Open — Four Go-To Tools That Sink Under Huge Files, and What Comes Next
#
showdev
#
vscode
#
productivity
#
devops
Comments
Add Comment
8 min read
The Day printf Debugging Hit 10GB — Four Ways to Live With Development Logs
y4u
y4u
y4u
Follow
Aug 30
The Day printf Debugging Hit 10GB — Four Ways to Live With Development Logs
#
showdev
#
debugging
#
programming
#
productivity
Comments
Add Comment
10 min read
You Found the ERROR. You Still Can't Find the Cause — Four Ways to Trace Causality in Logs
y4u
y4u
y4u
Follow
Aug 31
You Found the ERROR. You Still Can't Find the Cause — Four Ways to Trace Causality in Logs
#
showdev
#
debugging
#
devops
#
logging
Comments
Add Comment
9 min read
Where Finished Logs Go — Deciding Between Delete, Keep, and Compress
y4u
y4u
y4u
Follow
Sep 1
Where Finished Logs Go — Deciding Between Delete, Keep, and Compress
#
showdev
#
devops
#
logging
#
productivity
Comments
Add Comment
9 min read
Is ripgrep Really the Fastest on a 51 GB Single File? I Measured rg, grep, and My Own Viewer
y4u
y4u
y4u
Follow
Sep 4
Is ripgrep Really the Fastest on a 51 GB Single File? I Measured rg, grep, and My Own Viewer
#
showdev
#
performance
#
cli
#
rust
Comments
Add Comment
2 min read
Chasing an Outage by the Clock — Four Ways to Use Timestamps as Evidence
y4u
y4u
y4u
Follow
Sep 5
Chasing an Outage by the Clock — Four Ways to Use Timestamps as Evidence
#
devops
#
logging
#
sre
#
debugging
Comments
Add Comment
14 min read
Eight Minutes for zgrep, Every Single Time — Keeping Logs Compressed and Still Searchable
y4u
y4u
y4u
Follow
Sep 5
Eight Minutes for zgrep, Every Single Time — Keeping Logs Compressed and Still Searchable
#
showdev
#
devops
#
logging
#
storage
Comments
Add Comment
12 min read
Look at It Before You Feed It to jq — Four Times You Need the Raw Bytes
y4u
y4u
y4u
Follow
Sep 5
Look at It Before You Feed It to jq — Four Times You Need the Raw Bytes
#
logging
#
json
#
dataengineering
#
devops
Comments
Add Comment
11 min read
"Opens a Huge Log in Your Browser" Means Three Different Things
y4u
y4u
y4u
Follow
Sep 5
"Opens a Huge Log in Your Browser" Means Three Different Things
#
showdev
#
webassembly
#
performance
#
browser
Comments
Add Comment
3 min read
Making the On-Call Night Lighter — Four Things You Set Up for Your 2 A.M. Self
y4u
y4u
y4u
Follow
Sep 6
Making the On-Call Night Lighter — Four Things You Set Up for Your 2 A.M. Self
#
devops
#
sre
#
oncall
#
logging
Comments
Add Comment
11 min read
EUC-JP, UTF-16, and a Suspicion of EBCDIC — Reading Legacy Encodings in 2026
y4u
y4u
y4u
Follow
Sep 6
EUC-JP, UTF-16, and a Suspicion of EBCDIC — Reading Legacy Encodings in 2026
#
logging
#
encoding
#
unicode
#
devops
Comments
Add Comment
12 min read
"I Ordered It and It Never Arrived" — Four Support-Desk Log Investigations
y4u
y4u
y4u
Follow
Sep 6
"I Ordered It and It Never Arrived" — Four Support-Desk Log Investigations
#
logging
#
devops
#
sre
#
support
Comments
Add Comment
13 min read
EmEditor Beat My Editor 7 at 3 GB. Then We Opened a 50 GB File on a 16 GB Laptop.
y4u
y4u
y4u
Follow
Sep 6
EmEditor Beat My Editor 7 at 3 GB. Then We Opened a 50 GB File on a 16 GB Laptop.
#
showdev
#
performance
#
windows
#
benchmarking
Comments
Add Comment
3 min read
The Night the Log Wouldn't Read — Four Character-Encoding Traps and How to Tell Them Apart
y4u
y4u
y4u
Follow
Sep 6
The Night the Log Wouldn't Read — Four Character-Encoding Traps and How to Tell Them Apart
#
showdev
#
unicode
#
debugging
#
logging
Comments
Add Comment
9 min read
[AI Grades S–C] I Fed 10 of My Own Benchmarks to Gemini and ChatGPT: EmEditor at 3 GB, grep for One-Offs, My Tool Past 10 GB
y4u
y4u
y4u
Follow
Sep 7
[AI Grades S–C] I Fed 10 of My Own Benchmarks to Gemini and ChatGPT: EmEditor at 3 GB, grep for One-Offs, My Tool Past 10 GB
#
showdev
#
ai
#
performance
#
productivity
Comments
Add Comment
3 min read
[In Development] grep -v and grep -w, Now in a GUI: NOT Filters and Whole-Word Match for Huge-File Search
y4u
y4u
y4u
Follow
Sep 7
[In Development] grep -v and grep -w, Now in a GUI: NOT Filters and Whole-Word Match for Huge-File Search
#
showdev
#
cli
#
productivity
#
tooling
Comments
Add Comment
2 min read
[In Development] grep -v and grep -w, Now in a GUI: NOT Filters and Whole-Word Match for Huge-File Search
y4u
y4u
y4u
Follow
Sep 7
[In Development] grep -v and grep -w, Now in a GUI: NOT Filters and Whole-Word Match for Huge-File Search
#
showdev
#
cli
#
productivity
#
tooling
Comments
Add Comment
2 min read
Just Search and Replace: EmEditor, klogg, grep, 010 Editor, UltraEdit at 3/10/48 GB — Windows and Mac, Kept Separate
y4u
y4u
y4u
Follow
Sep 8
Just Search and Replace: EmEditor, klogg, grep, 010 Editor, UltraEdit at 3/10/48 GB — Windows and Mac, Kept Separate
#
showdev
#
performance
#
benchmarking
#
productivity
Comments
Add Comment
3 min read
sort | uniq -c | sort -rn, Now a GUI Button: Ranking 10,967 Hits' Top Values in 22 ms
y4u
y4u
y4u
Follow
Sep 8
sort | uniq -c | sort -rn, Now a GUI Button: Ranking 10,967 Hits' Top Values in 22 ms
#
showdev
#
cli
#
productivity
#
tooling
Comments
Add Comment
2 min read
Follow-up Tests: What I Learned by Re-testing the "Handles Huge Files" Claim
y4u
y4u
y4u
Follow
Sep 8
Follow-up Tests: What I Learned by Re-testing the "Handles Huge Files" Claim
#
showdev
#
cli
#
logging
#
performance
Comments
Add Comment
3 min read
grep, uniq -c and sed in a GUI — and the Parts That Don't Map (a CLI Cheat Sheet)
y4u
y4u
y4u
Follow
Sep 9
grep, uniq -c and sed in a GUI — and the Parts That Don't Map (a CLI Cheat Sheet)
#
showdev
#
cli
#
productivity
#
tooling
Comments
Add Comment
3 min read
258 GB, 4.5 Billion Lines, Five Questions: ripgrep Wins at N=1 and Loses at N=2
y4u
y4u
y4u
Follow
Sep 9
258 GB, 4.5 Billion Lines, Five Questions: ripgrep Wins at N=1 and Loses at N=2
#
showdev
#
cli
#
performance
#
tooling
Comments
Add Comment
6 min read
Only the Line Number Survived — Four Techniques for Inspecting Huge Data
y4u
y4u
y4u
Follow
Sep 11
Only the Line Number Survived — Four Techniques for Inspecting Huge Data
#
logging
#
devops
#
dataengineering
#
productivity
Comments
Add Comment
14 min read
The Traces Are in the Raw Log — Four Views on Lateral Movement, SQLi, and After-the-Fact Investigation
y4u
y4u
y4u
Follow
Sep 11
The Traces Are in the Raw Log — Four Views on Lateral Movement, SQLi, and After-the-Fact Investigation
#
security
#
logging
#
devops
#
sre
Comments
Add Comment
14 min read
"less Is Enough" — Until It Isn't: Four Limits of Command-Line Craft
y4u
y4u
y4u
Follow
Sep 11
"less Is Enough" — Until It Isn't: Four Limits of Command-Line Craft
#
linux
#
commandline
#
devops
#
performance
Comments
Add Comment
16 min read
Logs as Evidence — Four Principles for Preserving, Excerpting, and Proving Integrity
y4u
y4u
y4u
Follow
Sep 14
Logs as Evidence — Four Principles for Preserving, Excerpting, and Proving Integrity
#
security
#
devops
#
sre
#
logging
Comments
Add Comment
16 min read
Before You Carry Production Logs Home — Four Points of Friction Between Logs and Your Dev Environment
y4u
y4u
y4u
Follow
Sep 14
Before You Carry Production Logs Home — Four Points of Friction Between Logs and Your Dev Environment
#
devops
#
cicd
#
wsl
#
logging
Comments
Add Comment
13 min read
Ten Thousand Sensors, 1.4 Billion Lines a Day — Four Fields Where Machines Write the Logs
y4u
y4u
y4u
Follow
Sep 14
Ten Thousand Sensors, 1.4 Billion Lines a Day — Four Fields Where Machines Write the Logs
#
iot
#
logging
#
devops
#
datascience
Comments
Add Comment
14 min read
Following a Log That Won't Stop Growing — Four Situations Where tail -f Can't Keep Up
y4u
y4u
y4u
Follow
Sep 15
Following a Log That Won't Stop Growing — Four Situations Where tail -f Can't Keep Up
#
logging
#
devops
#
sre
#
linux
Comments
Add Comment
16 min read
"Please Produce the Logs from Three Years Ago" — Four Ways to Survive an Audit by Design
y4u
y4u
y4u
Follow
Sep 15
"Please Produce the Logs from Three Years Ago" — Four Ways to Survive an Audit by Design
#
audit
#
security
#
devops
#
logging
Comments
Add Comment
16 min read
The Morning the Monthly Batch Died — Four Realities of Running a Data Pipeline
y4u
y4u
y4u
Follow
Sep 15
The Morning the Monthly Batch Died — Four Realities of Running a Data Pipeline
#
dataengineering
#
etl
#
devops
#
cli
Comments
Add Comment
14 min read
Picking the One Place to Beat ripgrep — Read 1/9 of the Bytes, Then Hand the Result From the CLI to the GUI
y4u
y4u
y4u
Follow
Sep 16
Picking the One Place to Beat ripgrep — Read 1/9 of the Bytes, Then Hand the Result From the CLI to the GUI
#
showdev
#
ripgrep
#
cli
#
performance
Comments
Add Comment
9 min read
I Thought We Lost at 3 GB — Turns Out We'd Won (As Long as the Cache Is Cold)
y4u
y4u
y4u
Follow
Sep 16
I Thought We Lost at 3 GB — Turns Out We'd Won (As Long as the Cache Is Cold)
#
showdev
#
ripgrep
#
cli
#
productivity
Comments
Add Comment
10 min read
ripgrep Is 2.9x Faster With no-mmap — Measured Against the Default mmap Read on One 51 GB File, on Three OSes
y4u
y4u
y4u
Follow
Sep 18
ripgrep Is 2.9x Faster With no-mmap — Measured Against the Default mmap Read on One 51 GB File, on Three OSes
#
showdev
#
ripgrep
#
cli
#
performance
Comments
Add Comment
5 min read
We Lose to klogg on Opening. uvf Wins the Whole Run — Re-measured at 50 GB
y4u
y4u
y4u
Follow
Sep 18
We Lose to klogg on Opening. uvf Wins the Whole Run — Re-measured at 50 GB
#
showdev
#
logging
#
cli
#
performance
Comments
Add Comment
8 min read
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account