<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Logan</title>
    <description>The latest articles on DEV Community by Logan (@iamatu).</description>
    <link>https://dev.to/iamatu</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4251137%2Fc99e5026-59a8-4d9c-a3fb-dd50001cd73c.png</url>
      <title>DEV Community: Logan</title>
      <link>https://dev.to/iamatu</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/iamatu"/>
    <language>en</language>
    <item>
      <title>What 247 Million Power Outage Records Can Actually Tell Us</title>
      <dc:creator>Logan</dc:creator>
      <pubDate>Wed, 18 Nov 2026 06:47:13 +0000</pubDate>
      <link>https://dev.to/iamatu/what-247-million-power-outage-records-can-actually-tell-us-k2j</link>
      <guid>https://dev.to/iamatu/what-247-million-power-outage-records-can-actually-tell-us-k2j</guid>
      <description>&lt;p&gt;The U.S. outage records for 2025 add up to &lt;strong&gt;52.8% fewer reported customer-hours&lt;/strong&gt; than the records for 2024. How much of that gap comes from a handful of severe days? Drop each year’s ten highest-burden days and the difference is still &lt;strong&gt;41.3%&lt;/strong&gt;.&lt;/p&gt;

&lt;p&gt;That check took a few lines of Python. Deciding what to sum took more care. The data behind this comparison cover 11 calendar years, 2015–2025, and about 247.6 million source rows. Each row is a county-level observation, with a timestamp and a count of customers reported out at that moment.&lt;/p&gt;

&lt;h2&gt;
  
  
  What a snapshot can measure
&lt;/h2&gt;

&lt;p&gt;Suppose a county reports 400 customers out at 08:00 UTC and 600 at 08:15. At the source’s nominal 15-minute cadence, those samples contribute (400 + 600) × 0.25 = &lt;strong&gt;250 customer-hours&lt;/strong&gt;. The second snapshot can represent a different set of customers. The data lack the customer IDs needed to reconstruct individual outage durations.&lt;/p&gt;

&lt;p&gt;An earlier version of the analysis stitched county snapshots together when gaps were short. That could turn a moving set of small outages into one apparently long event. It could also put an entire event into the year it started. The revised pipeline assigns every valid snapshot to its own UTC day and year. It sums positive integer counts, uses 0.25 hours as a nominal weight, and leaves collection gaps unfilled. The manifest tracks off-grid timestamps and input hashes. A missing row leaves coverage unknown.&lt;/p&gt;

&lt;p&gt;The build reads each CSV in 500,000-row chunks and writes daily and county-year summaries. When validating a published number, the small annual CSV is enough. Use the source archive and manifest if you need to audit the raw inputs.&lt;/p&gt;

&lt;h2&gt;
  
  
  How much does the 2024–2025 comparison move?
&lt;/h2&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Calculation&lt;/th&gt;
&lt;th&gt;2024 customer-hours&lt;/th&gt;
&lt;th&gt;2025 customer-hours&lt;/th&gt;
&lt;th&gt;Change&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;All valid snapshots&lt;/td&gt;
&lt;td&gt;1,891.7 million&lt;/td&gt;
&lt;td&gt;892.7 million&lt;/td&gt;
&lt;td&gt;−52.8%&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Exclude snapshots above the modeled county customer count where a match exists&lt;/td&gt;
&lt;td&gt;1,664.9 million&lt;/td&gt;
&lt;td&gt;859.6 million&lt;/td&gt;
&lt;td&gt;−48.4%&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Counties with positive records in all 11 years&lt;/td&gt;
&lt;td&gt;1,606.7 million&lt;/td&gt;
&lt;td&gt;687.3 million&lt;/td&gt;
&lt;td&gt;−57.2%&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Exclude each year’s 10 highest-burden days&lt;/td&gt;
&lt;td&gt;1,311.6 million&lt;/td&gt;
&lt;td&gt;770.4 million&lt;/td&gt;
&lt;td&gt;−41.3%&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;The top ten days account for 30.7% of the recorded total in 2024 and 13.7% in 2025. Removing them narrows the gap. The county screen is another sensitivity check. Its denominator is a modeled 2022 customer count, so a flagged row merits inspection. The 2,311-county subset checks whether the result holds within the same group of counties across years. A positive record in every year still leaves coverage within each year uncertain.&lt;/p&gt;

&lt;h2&gt;
  
  
  Reproduce the table with Python
&lt;/h2&gt;

&lt;p&gt;Download the &lt;a href="https://wattsizer.org/data/outage/annual.csv" rel="noopener noreferrer"&gt;annual CSV&lt;/a&gt; beside your script and run it with Python 3. The numbers below come from the published aggregates.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="k"&gt;import&lt;/span&gt; &lt;span class="n"&gt;csv&lt;/span&gt;
&lt;span class="k"&gt;from&lt;/span&gt; &lt;span class="n"&gt;decimal&lt;/span&gt; &lt;span class="k"&gt;import&lt;/span&gt; &lt;span class="nc"&gt;Decimal&lt;/span&gt;

&lt;span class="k"&gt;with&lt;/span&gt; &lt;span class="nb"&gt;open&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"annual.csv"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;encoding&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="s2"&gt;"utf-8-sig"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;newline&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="s2"&gt;""&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="k"&gt;as&lt;/span&gt; &lt;span class="n"&gt;source&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="n"&gt;rows&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="kt"&gt;int&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;row&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"year"&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="n"&gt;row&lt;/span&gt; &lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;row&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="n"&gt;csv&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nc"&gt;DictReader&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;source&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;


&lt;span class="k"&gt;def&lt;/span&gt; &lt;span class="nf"&gt;amount&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;year&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;column&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="k"&gt;return&lt;/span&gt; &lt;span class="nc"&gt;Decimal&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;rows&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="n"&gt;year&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="n"&gt;column&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;


&lt;span class="k"&gt;def&lt;/span&gt; &lt;span class="nf"&gt;compare&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;label&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;before&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;after&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="n"&gt;change&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="mi"&gt;100&lt;/span&gt; &lt;span class="o"&gt;*&lt;/span&gt; &lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;after&lt;/span&gt; &lt;span class="o"&gt;/&lt;/span&gt; &lt;span class="n"&gt;before&lt;/span&gt; &lt;span class="o"&gt;-&lt;/span&gt; &lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="k"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;f&lt;/span&gt;&lt;span class="s2"&gt;"{label}: {before:,.0f} -&amp;gt; {after:,.0f} ({change:+.1f}%)"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;


&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;column&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;label&lt;/span&gt; &lt;span class="k"&gt;in&lt;/span&gt; &lt;span class="p"&gt;(&lt;/span&gt;
    &lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"ch"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"All valid snapshots"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"screen1"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"County customer screen"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
    &lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"common_ch"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"Counties with records every year"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="nf"&gt;compare&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;label&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nf"&gt;amount&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="mi"&gt;2024&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;column&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nf"&gt;amount&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="mi"&gt;2025&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;column&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;


&lt;span class="k"&gt;def&lt;/span&gt; &lt;span class="nf"&gt;without_top_days&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;year&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
    &lt;span class="k"&gt;return&lt;/span&gt; &lt;span class="nf"&gt;amount&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;year&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"ch"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="o"&gt;-&lt;/span&gt; &lt;span class="nf"&gt;amount&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;year&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="s2"&gt;"top10_ch"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;


&lt;span class="nf"&gt;compare&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s2"&gt;"Without the top ten days"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nf"&gt;without_top_days&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="mi"&gt;2024&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="nf"&gt;without_top_days&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="mi"&gt;2025&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;All four comparisons point in the same direction. The size of the decline depends on how you handle coverage, high observations and concentrated days. A reliability claim would need consistent reporting coverage or an independent benchmark. The most useful thing to publish alongside the headline is the rule for turning a single row into a number a reader can reproduce.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Data and methods.&lt;/strong&gt; I publish the &lt;a href="https://wattsizer.org/power-outage-report/methodology/" rel="noopener noreferrer"&gt;WattSizer outage methods and source manifest&lt;/a&gt;. The &lt;a href="https://doi.org/10.1038/s41597-024-03095-5" rel="noopener noreferrer"&gt;EAGLE-I data descriptor&lt;/a&gt; covers 2014–2022. The later files are listed separately in the manifest. AI was used to draft this write-up from the published analysis and check the reproducible example.&lt;/p&gt;

</description>
      <category>dataengineering</category>
      <category>python</category>
      <category>datascience</category>
    </item>
  </channel>
</rss>
