Qwen3 4B vs 8B vs 14B for Writing Correction: 60 Local Ollama Responses on Windows

I expected the larger Qwen3 model to show a clear advantage for writing correction. In this experiment, it didn't.

Across 20 paired writing cases, Qwen3 8B and 14B both achieved 19/20 complete-case corrections, while Qwen3 4B reached 18/20.

The difference became much more noticeable in local execution time: in the tested cold-start setup, the mean cold-start time for Qwen3 8B was roughly half that of Qwen3 14B.

That raised a practical question:

For a local writing assistant, how much model size do we actually need?

To explore this more systematically, I built a reproducible benchmark comparing Qwen3 4B, 8B and 14B under the same local conditions with Ollama on Windows.

Benchmark setup

The benchmark uses 20 paired writing cases, including 16 sentences with expected errors and 4 already-correct controls.

Each case was evaluated with the same reference and the same evaluation framework across three locally hosted Qwen3 models:

• qwen3:4b-q4_K_M
• qwen3:8b-q4_K_M
• qwen3:14b-q4_K_M

This produced 60 local responses in total.

The models were executed through Ollama on Windows under the same test conditions. The objective was not to identify a universal “best model,” but to compare several dimensions separately:

• complete correction of the expected errors;
• localization of the error regions;
• preservation of the original meaning;
• compliance with the requested output structure;
• quality of the explanations;
• local execution time.

For the primary metric discussed here, a case was considered complete only when the expected correction requirements for that case were satisfied.

Results

Complete-case correction

The primary correction results were close:

• Qwen3 4B: 18/20 complete cases — 90%
• Qwen3 8B: 19/20 complete cases — 95%
• Qwen3 14B: 19/20 complete cases — 95%

On this metric alone, increasing the model size from 8B to 14B did not improve the number of complete cases in this test.

Local execution time

The difference was much larger in execution time.

In the tested cold-start configuration, the mean cold-start times were approximately:

• Qwen3 4B: 26.6 s
• Qwen3 8B: 60.0 s
• Qwen3 14B: 119.4 s

So, while 8B and 14B achieved the same complete-case score, Qwen3 8B took about half as long as Qwen3 14B on average in this cold-start setup.

The 4B model was substantially faster again, while still completing 18 of the 20 cases.

This does not mean that 8B is universally better than 14B. It means that, for this specific writing-correction workload and hardware configuration, the additional model size did not translate into a better primary correction score, while the execution-time cost increased considerably.

Error localization and explanation quality

Complete-case correction and error localization measure different aspects of model behavior.

Across the 21 expected error regions:

• Qwen3 4B missed one expected region, with an error-localization F1 of 97.6%.
• Qwen3 8B localized all 21 expected regions, reaching 100% F1.
• Qwen3 14B missed one expected region and reported one false-positive region, resulting in 95.2% F1.

This distinction matters for a writing coach: producing an acceptable corrected sentence does not necessarily mean that the model identified the underlying error with the same precision.

Explanation quality was therefore evaluated separately from correction success.

In this run, all 41 evaluated explanation fields produced by Qwen3 8B passed the language check. Qwen3 4B showed more explanation-language and terminology issues.

These automatic checks should not be interpreted as a complete measure of pedagogical quality. They cover selected language patterns and contradictions, while deeper explanation quality remains a separate area for linguistic review.

What this means for local writing assistants

The main takeaway is not that one model is universally better than another.

In this benchmark, the three Qwen3 models produced relatively similar complete-case correction results, but their local execution times differed much more substantially.

For this specific workload:

• 4B offered the lowest execution time, with a small reduction in correction coverage.
• 8B matched 14B on complete-case correction and achieved the strongest error-localization result in this run.
• 14B did not improve the primary correction score over 8B, while requiring substantially more execution time in the tested configuration.

This suggests that model selection for a local writing assistant should be treated as a multi-criteria decision, rather than assuming that a larger model will automatically provide the best practical experience.

Depending on the use case and available hardware, the relevant trade-off may involve:

• correction reliability;
• explanation quality;
• latency;
• memory and compute requirements;
• and the expected frequency of use.

For a writing coach in particular, responsiveness also matters. A model that is slightly larger or theoretically more capable may not necessarily provide the best user experience if each interaction becomes significantly slower.

Limitations

This benchmark is exploratory and should be interpreted within its experimental scope.

Several limitations are important:

• 20 paired cases: the dataset is intentionally focused and is not large enough to support a universal ranking of the models.
• One language scenario: the benchmark evaluates English writing correction with explanations requested in French. Results may differ for other languages or writing tasks.
• One model family: only Qwen3 4B, 8B and 14B were compared. The results should not be generalized to other local model families.
• One local machine: execution time depends on hardware, model quantization, available memory and Ollama configuration.
• Cold-start timing: Ollama was configured with keep_alive=0, meaning the model was reloaded for each response. The reported timings therefore represent this specific cold-start workflow rather than warm-start interaction latency.
• Reference-based evaluation: outputs were compared against a frozen, versioned correction reference prepared for this study. This improves consistency across models, but it does not capture every possible acceptable linguistic formulation.
• Explanation-quality checks: automatic checks cover selected language patterns and contradictions. They should not be treated as a complete assessment of pedagogical or linguistic quality.

These limitations are also why the benchmark is presented as a controlled comparison rather than a claim about the absolute capabilities of each model.

What I plan to test next

This first benchmark leaves several useful directions open for further evaluation.

The next iterations could extend the framework in four directions:

• compare additional local model families under the same evaluation protocol;
• examine explanation quality with deeper linguistic and human review;
• compare cold-start and warm-start performance;
• evaluate the same workflow on more constrained hardware.

A larger and more diverse test set would also help determine whether the patterns observed here remain stable beyond these 20 cases.

I am particularly interested in whether the 8B/14B trade-off observed in this run persists when the task becomes more linguistically demanding.

Conclusion

This experiment did not produce a universal winner, but it did highlight an important practical point: model size alone is not a sufficient criterion for choosing a local writing model.

For this specific workload, Qwen3 8B matched 14B on complete-case correction while its mean cold-start time was roughly half that of 14B in the tested configuration.

The more useful question, therefore, may not be “Which model is the largest?” but rather:

Which model provides the best balance between correction quality, explanation quality, responsiveness, and available hardware for the intended use case?

If you use local LLMs for writing assistance or other interactive tasks, I would be interested to know which trade-off matters most in your own setup: quality, latency, memory requirements, or something else?

---

Disclosure: AI assistance was used to refine the wording and organization of this article. The benchmark results and measurements reported here come from the documented experimental runs and were reviewed for accuracy before publication.