<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Invosmith</title>
    <description>The latest articles on DEV Community by Invosmith (@invosmith).</description>
    <link>https://dev.to/invosmith</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4250624%2F40417a3a-2e67-4dbd-8fcd-bd44536a9b8e.png</url>
      <title>DEV Community: Invosmith</title>
      <link>https://dev.to/invosmith</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/invosmith"/>
    <language>en</language>
    <item>
      <title>DeOldify vs DDColor vs BigColor: Measuring Colorization Error with CIEDE2000 (and the Code)</title>
      <dc:creator>Invosmith</dc:creator>
      <pubDate>Wed, 18 Nov 2026 17:37:52 +0000</pubDate>
      <link>https://dev.to/revivophoto/deoldify-vs-ddcolor-vs-bigcolor-measuring-colorization-error-with-ciede2000-and-the-code-3ibg</link>
      <guid>https://dev.to/revivophoto/deoldify-vs-ddcolor-vs-bigcolor-measuring-colorization-error-with-ciede2000-and-the-code-3ibg</guid>
      <description>&lt;p&gt;&lt;strong&gt;Short answer:&lt;/strong&gt; On ten gray-converted Prokudin-Gorskii color photos, DeOldify's median whole-image error was 9.55 ΔE2000 (DDColor 9.32, BigColor 9.04), so on average it is no worse than the newer models. The catch is how it gets there: it under-saturates. Across 34 measured zones its mean chroma was 9.5 against 18.9 in the real photos. It also misses skies in some images, and the hosted version we ran stamps a small icon in the bottom-left corner.&lt;/p&gt;

&lt;h2&gt;
  
  
  How does DeOldify work?
&lt;/h2&gt;

&lt;p&gt;&lt;a href="https://github.com/jantic/DeOldify" rel="noopener noreferrer"&gt;DeOldify&lt;/a&gt; is a U-Net generator trained as a GAN with a staged recipe its author calls NoGAN: pretrain the generator, pretrain a critic to tell real from colorized, then run only a short stretch of adversarial training. Per the README, the default "artistic" model uses a resnet34 backbone, the "stable" model uses resnet101, and a &lt;code&gt;render_factor&lt;/code&gt; setting trades render resolution against stability. The repository was archived in October 2024.&lt;/p&gt;

&lt;p&gt;The task is under-determined: a gray pixel does not say whether a scarf was red or green, which is why the &lt;a href="https://arxiv.org/abs/2212.11613" rel="noopener noreferrer"&gt;DDColor paper&lt;/a&gt; opens by calling colorization a problem of multi-modal uncertainty and high ill-posedness. The engineering question is how far the plausible answer is from the true one.&lt;/p&gt;

&lt;h2&gt;
  
  
  How do you measure colorization error?
&lt;/h2&gt;

&lt;p&gt;Start from color and make the gray yourself. We used ten public-domain Prokudin-Gorskii three-filter composites from Wikimedia Commons (churches, a lake, tile work, no people), cropped 5% per edge, resized to 1024 px and converted to grayscale with PIL. Each model ran once with default settings on Replicate: DDColor (large), DeOldify Artistic at &lt;code&gt;render_factor=35&lt;/code&gt;, BigColor in "Real Gray Colorization" mode.&lt;/p&gt;

&lt;p&gt;The metric is CIEDE2000 (see the &lt;a href="https://doi.org/10.1002/col.20070" rel="noopener noreferrer"&gt;Sharma, Wu and Dalal implementation notes&lt;/a&gt; for getting the formula right), computed per pixel in CIELAB; 0 means identical. We took the median for the whole image and for hand-boxed zones (sky, vegetation, water, building, painted roof, glazed tile). A second value forces the output's lightness to equal the original's, isolating color-only error. The key lines of &lt;code&gt;metrics.py&lt;/code&gt; (lightly abridged):&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="k"&gt;from&lt;/span&gt; &lt;span class="n"&gt;skimage&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;color&lt;/span&gt; &lt;span class="k"&gt;import&lt;/span&gt; &lt;span class="n"&gt;rgb2lab&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;deltaE_ciede2000&lt;/span&gt;

&lt;span class="k"&gt;def&lt;/span&gt; &lt;span class="nf"&gt;lab&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;p&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;size&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="kc"&gt;None&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="n"&gt;im&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;Image&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nb"&gt;open&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;p&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;convert&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s1"&gt;'RGB'&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="n"&gt;size&lt;/span&gt; &lt;span class="ow"&gt;and&lt;/span&gt; &lt;span class="n"&gt;im&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;size&lt;/span&gt; &lt;span class="o"&gt;!=&lt;/span&gt; &lt;span class="n"&gt;size&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="n"&gt;im&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;im&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;resize&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;size&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nc"&gt;Image&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="no"&gt;LANCZOS&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="k"&gt;return&lt;/span&gt; &lt;span class="nf"&gt;rgb2lab&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;np&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;asarray&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;im&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="o"&gt;/&lt;/span&gt;&lt;span class="mf"&gt;255.0&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;

&lt;span class="no"&gt;T&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nf"&gt;lab&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;f&lt;/span&gt;&lt;span class="s1"&gt;'color/{s}.png'&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="no"&gt;H&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="no"&gt;W&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="no"&gt;T&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;shape&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="mi"&gt;2&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;      &lt;span class="c1"&gt;# truth&lt;/span&gt;
&lt;span class="no"&gt;A&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nf"&gt;lab&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;p&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="no"&gt;W&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="no"&gt;H&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;                                  &lt;span class="c1"&gt;# model output&lt;/span&gt;
&lt;span class="n"&gt;dE&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nf"&gt;deltaE_ciede2000&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="no"&gt;T&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="no"&gt;A&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="no"&gt;A2&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="no"&gt;A&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;copy&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="no"&gt;A2&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;0&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="no"&gt;T&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;0&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;               &lt;span class="c1"&gt;# keep true lightness&lt;/span&gt;
&lt;span class="n"&gt;dEc&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nf"&gt;deltaE_ciede2000&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="no"&gt;T&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="no"&gt;A2&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;                       &lt;span class="c1"&gt;# color-only error&lt;/span&gt;

&lt;span class="n"&gt;sl&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="nb"&gt;slice&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="kt"&gt;int&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;y0&lt;/span&gt;&lt;span class="o"&gt;*&lt;/span&gt;&lt;span class="no"&gt;H&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="kt"&gt;int&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;y1&lt;/span&gt;&lt;span class="o"&gt;*&lt;/span&gt;&lt;span class="no"&gt;H&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nb"&gt;slice&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="kt"&gt;int&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;x0&lt;/span&gt;&lt;span class="o"&gt;*&lt;/span&gt;&lt;span class="no"&gt;W&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="kt"&gt;int&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;x1&lt;/span&gt;&lt;span class="o"&gt;*&lt;/span&gt;&lt;span class="no"&gt;W&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="n"&gt;t&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;np&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;median&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="no"&gt;T&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="n"&gt;sl&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;reshape&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="o"&gt;-&lt;/span&gt;&lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;3&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;0&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="n"&gt;a&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;np&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;median&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="no"&gt;A&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="n"&gt;sl&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;reshape&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="o"&gt;-&lt;/span&gt;&lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;3&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;0&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="n"&gt;dm&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="kt"&gt;float&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="nf"&gt;deltaE_ciede2000&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;t&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="kc"&gt;None&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;a&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="kc"&gt;None&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;0&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;   &lt;span class="c1"&gt;# error of the median color&lt;/span&gt;
&lt;span class="n"&gt;ct&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;np&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;hypot&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;t&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;t&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;2&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="n"&gt;ca&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;np&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;hypot&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;a&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;a&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;2&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;  &lt;span class="c1"&gt;# chroma&lt;/span&gt;
&lt;span class="n"&gt;hd&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nb"&gt;abs&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="nf"&gt;hue&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;t&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;t&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;2&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="o"&gt;-&lt;/span&gt; &lt;span class="nf"&gt;hue&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;a&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;a&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;2&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="o"&gt;+&lt;/span&gt; &lt;span class="mi"&gt;180&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="o"&gt;%&lt;/span&gt; &lt;span class="mi"&gt;360&lt;/span&gt; &lt;span class="o"&gt;-&lt;/span&gt; &lt;span class="mi"&gt;180&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="n"&gt;hw&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;ct&lt;/span&gt; &lt;span class="o"&gt;&amp;gt;&lt;/span&gt; &lt;span class="mi"&gt;8&lt;/span&gt; &lt;span class="ow"&gt;and&lt;/span&gt; &lt;span class="n"&gt;ca&lt;/span&gt; &lt;span class="o"&gt;&amp;gt;&lt;/span&gt; &lt;span class="mi"&gt;8&lt;/span&gt; &lt;span class="ow"&gt;and&lt;/span&gt; &lt;span class="n"&gt;hd&lt;/span&gt; &lt;span class="o"&gt;&amp;gt;&lt;/span&gt; &lt;span class="mi"&gt;40&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="ow"&gt;or&lt;/span&gt; &lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;ct&lt;/span&gt; &lt;span class="o"&gt;&amp;gt;&lt;/span&gt; &lt;span class="mi"&gt;15&lt;/span&gt; &lt;span class="ow"&gt;and&lt;/span&gt; &lt;span class="n"&gt;ca&lt;/span&gt; &lt;span class="o"&gt;&amp;lt;&lt;/span&gt; &lt;span class="mi"&gt;5&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="n"&gt;wrong&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;dm&lt;/span&gt; &lt;span class="o"&gt;&amp;gt;=&lt;/span&gt; &lt;span class="mi"&gt;15&lt;/span&gt; &lt;span class="ow"&gt;or&lt;/span&gt; &lt;span class="n"&gt;hw&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The &lt;code&gt;wrong&lt;/code&gt; flag is our own uncalibrated rule: median color 15+ ΔE2000 away, or hue off by over 40° with both colors chromatic, or a clearly colored truth rendered nearly gray. For the same ground-truth habit on a different task, see &lt;a href="https://dev.to/aitoolweb/measuring-unblur-tools-against-ground-truth-sharper-isnt-closer-53fl"&gt;Measuring "unblur" tools against ground truth&lt;/a&gt;; its author discloses working on one of the tools tested, and we only borrow the method.&lt;/p&gt;

&lt;h2&gt;
  
  
  What did DeOldify score against DDColor and BigColor?
&lt;/h2&gt;

&lt;p&gt;Whole-image median ΔE2000 per photo, then the median and mean over ten photos (all numbers from &lt;code&gt;results.csv&lt;/code&gt;):&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Model&lt;/th&gt;
&lt;th&gt;Median&lt;/th&gt;
&lt;th&gt;Mean&lt;/th&gt;
&lt;th&gt;Range&lt;/th&gt;
&lt;th&gt;Clearly wrong zones (of 34)&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;DeOldify (Artistic, rf 35)&lt;/td&gt;
&lt;td&gt;9.55&lt;/td&gt;
&lt;td&gt;9.47&lt;/td&gt;
&lt;td&gt;6.53–14.98&lt;/td&gt;
&lt;td&gt;9&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;DDColor (large)&lt;/td&gt;
&lt;td&gt;9.32&lt;/td&gt;
&lt;td&gt;9.69&lt;/td&gt;
&lt;td&gt;5.90–15.13&lt;/td&gt;
&lt;td&gt;9&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;BigColor&lt;/td&gt;
&lt;td&gt;9.04&lt;/td&gt;
&lt;td&gt;9.26&lt;/td&gt;
&lt;td&gt;6.76–12.77&lt;/td&gt;
&lt;td&gt;6&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;The three are within about half a ΔE of each other, which with ten images and one run each is a tie. Per photo it is less of a tie: DeOldify beat DDColor on 7 of 10 images (p01, p02, p03, p09, p10, p11, p12) and BigColor on 7 of 10 (p01, p02, p08, p09, p10, p11, p12). Its best case was p10 (8.36 versus 15.13 and 9.71); its worst was p07 (14.98 versus 8.14 and 9.56).&lt;/p&gt;

&lt;p&gt;By zone, medians of the per-zone ΔE2000 (clearly wrong count in brackets):&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Zone (n)&lt;/th&gt;
&lt;th&gt;DeOldify&lt;/th&gt;
&lt;th&gt;DDColor&lt;/th&gt;
&lt;th&gt;BigColor&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;Sky (9)&lt;/td&gt;
&lt;td&gt;8.8 (3)&lt;/td&gt;
&lt;td&gt;5.8 (4)&lt;/td&gt;
&lt;td&gt;7.3 (1)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Vegetation (7)&lt;/td&gt;
&lt;td&gt;12.8 (2)&lt;/td&gt;
&lt;td&gt;11.9 (1)&lt;/td&gt;
&lt;td&gt;9.9 (2)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Building (8)&lt;/td&gt;
&lt;td&gt;9.7 (1)&lt;/td&gt;
&lt;td&gt;9.7 (1)&lt;/td&gt;
&lt;td&gt;9.3 (0)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Painted roof (6)&lt;/td&gt;
&lt;td&gt;11.4 (1)&lt;/td&gt;
&lt;td&gt;16.0 (2)&lt;/td&gt;
&lt;td&gt;13.7 (2)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Water (2)&lt;/td&gt;
&lt;td&gt;9.7 (1)&lt;/td&gt;
&lt;td&gt;10.6 (1)&lt;/td&gt;
&lt;td&gt;10.8 (0)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Glazed tile (2)&lt;/td&gt;
&lt;td&gt;15.1 (1)&lt;/td&gt;
&lt;td&gt;11.1 (0)&lt;/td&gt;
&lt;td&gt;16.8 (1)&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;Water and glazed tile have two samples each; read those rows as anecdotes.&lt;/p&gt;

&lt;h2&gt;
  
  
  What colors does DeOldify get wrong, and why is the bottom-left corner marked?
&lt;/h2&gt;

&lt;p&gt;The error is not mainly wrong hue. It is missing color. Over the 21 zones where the real chroma was above 15, DeOldify's median chroma was 0.33 of the truth, against 0.83 for DDColor and 0.72 for BigColor. In four zones DeOldify returned chroma under 5 where the real photo was above 15: the painted roof in p01 (2.1 against 29.3), the sky in p03 (0.7 against 17.7), a building in p04 and glazed tile in p09. A near-gray guess scores a moderate ΔE2000 almost everywhere, which is how a washed-out model can still post a median close to its colorful rivals.&lt;/p&gt;

&lt;p&gt;Skies are the sharper failure. In p07 the real sky had chroma 36.7 and DeOldify returned 5.1, a zone error of 24.79. In p08 its sky came back 154 degrees off in hue (zone error 21.36). In p03 the hue was off by 77 degrees (13.46). The safe default is gray.&lt;/p&gt;

&lt;p&gt;The corner mark: the Replicate-hosted DeOldify image model we used (&lt;code&gt;arielreplicate/deoldify_image&lt;/code&gt;) put a small icon in the bottom-left of its output, which we left in place. Crop it before scoring or shipping; we did not check other deployments.&lt;/p&gt;

&lt;h2&gt;
  
  
  When should you use DeOldify?
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Use it&lt;/strong&gt; for a restrained, easy-to-reproduce baseline when a muted look is acceptable.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Don't trust it alone&lt;/strong&gt; for skies, saturated paint and tile; check them against a second model.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Prefer another model&lt;/strong&gt; if saturation matters: DDColor kept 0.83 of the true chroma, at the cost of 4 wrong skies in 9.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Treat colors as guesses&lt;/strong&gt; either way. If you just need &lt;a href="https://revivophoto.com/colorize-photo/" rel="noopener noreferrer"&gt;black and white to color&lt;/a&gt; without setup, a hosted tool avoids it, but it predicts color too; nothing here shows it is more accurate than the models above.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fv8mtitzf77gf0nhyu41s.jpg" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fv8mtitzf77gf0nhyu41s.jpg" alt="Three Prokudin-Gorskii photos shown in five columns: original, grayscale, DDColor, DeOldify and BigColor; source Library of Congress via Wikimedia Commons" width="800" height="462"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  How do you reproduce this?
&lt;/h2&gt;

&lt;p&gt;Gray your own color set, run each model once, then run &lt;code&gt;metrics.py&lt;/code&gt; with a &lt;code&gt;boxes.json&lt;/code&gt; of proportional zone coordinates. Pin versions (ours on Replicate: DDColor &lt;code&gt;ca494ba129e4…&lt;/code&gt;, DeOldify &lt;code&gt;0da600fab0c4…&lt;/code&gt;, BigColor &lt;code&gt;9451bfbf652b…&lt;/code&gt;). Limits: 10 photos, one run per model, hand-drawn boxes, a ground truth that is a filter composite with color casts (skies especially), small zone samples, our own thresholds, no people.&lt;/p&gt;

&lt;h2&gt;
  
  
  FAQ
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;Is DeOldify still maintained?&lt;/strong&gt; The README says the repository was archived in October 2024, so expect no new releases.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Is a lower ΔE2000 always better?&lt;/strong&gt; No. It rewards safe gray. Look at chroma and per-zone errors as well as the median.&lt;/p&gt;

&lt;h2&gt;
  
  
  References
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;jantic. &lt;em&gt;DeOldify&lt;/em&gt; (GitHub, archived October 2024). &lt;a href="https://github.com/jantic/DeOldify" rel="noopener noreferrer"&gt;github.com/jantic/DeOldify&lt;/a&gt;
&lt;/li&gt;
&lt;li&gt;Kang, X. et al. (2022). &lt;em&gt;DDColor: Towards Photo-Realistic Image Colorization via Dual Decoders&lt;/em&gt;. &lt;a href="https://arxiv.org/abs/2212.11613" rel="noopener noreferrer"&gt;arXiv:2212.11613&lt;/a&gt;
&lt;/li&gt;
&lt;li&gt;Sharma, G., Wu, W., Dalal, E. N. (2005). &lt;em&gt;The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations&lt;/em&gt;. Color Research &amp;amp; Application. &lt;a href="https://doi.org/10.1002/col.20070" rel="noopener noreferrer"&gt;doi:10.1002/col.20070&lt;/a&gt;
&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;em&gt;The Revivo Photo team. Questions about the code or the zones? Ask in the comments.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>python</category>
      <category>machinelearning</category>
      <category>computervision</category>
      <category>tutorial</category>
    </item>
  </channel>
</rss>
