<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: SnackIQ</title>
    <description>The latest articles on DEV Community by SnackIQ (@snackiq_app).</description>
    <link>https://dev.to/snackiq_app</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F3868537%2F519930fa-d56d-4926-a86c-945b5f8b73a5.png</url>
      <title>DEV Community: SnackIQ</title>
      <link>https://dev.to/snackiq_app</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/snackiq_app"/>
    <language>en</language>
    <item>
      <title>Why AI Training Actually Eats Your Grid</title>
      <dc:creator>SnackIQ</dc:creator>
      <pubDate>Mon, 07 Sep 2026 14:01:54 +0000</pubDate>
      <link>https://dev.to/snackiq_app/why-ai-training-actually-eats-your-grid-22fm</link>
      <guid>https://dev.to/snackiq_app/why-ai-training-actually-eats-your-grid-22fm</guid>
      <description>&lt;p&gt;&lt;a href="https://[snackiq](https://snackiq.app/glossary/snackiq).app/glossary/how-much-electricity-does-ai-training-use" rel="noopener noreferrer"&gt;How much electricity does AI training use&lt;/a&gt;? Enough to make power grid engineers nervous. Training GPT-3, OpenAI's 2020 language model, consumed an estimated 1,287 megawatt-hours of electricity, roughly what 120 average American homes use in a year, according to researchers at the University of Massachusetts Amherst. And that was five years ago, before the models got dramatically larger. Today's frontier models require orders of magnitude more. The International Energy Agency projected in 2024 that global data centre electricity demand could double by 2026, with AI workloads driving a significant portion of that growth. This isn't a side effect of AI. It's physics. Understanding why reveals something fundamental about how machine learning actually works.&lt;/p&gt;

&lt;h2&gt;
  
  
  What actually happens during AI training?
&lt;/h2&gt;

&lt;p&gt;Most people picture AI training as something like a student reading textbooks. It's not. It's closer to a student rewriting the same exam paper billions of times, adjusting one tiny mark each pass, until the answers start improving.&lt;/p&gt;

&lt;p&gt;Every AI model, whether it's an image recogniser or a language model, is built from a neural network: a vast web of numerical parameters called &lt;strong&gt;weights&lt;/strong&gt;. At the start of training, these weights are essentially random. The model makes terrible predictions. Then the training process kicks in.&lt;/p&gt;

&lt;p&gt;Here's the cycle that repeats billions of times. The model sees a piece of data, a sentence, an image, a chunk of text. It makes a prediction. The prediction is compared to the correct answer. The difference (the error) is calculated. Then an algorithm called &lt;strong&gt;backpropagation&lt;/strong&gt; works backwards through the network, figuring out which weights contributed most to the error. Each weight gets nudged, slightly, in a direction that would reduce that error next time. Then the whole thing starts again.&lt;/p&gt;

&lt;p&gt;For a model like GPT-4, which reportedly has hundreds of billions of parameters, that adjustment process runs across an enormous number of weights, for every single example in the training dataset, across potentially trillions of tokens of text. Each individual mathematical operation is simple. Multiply two numbers. Add them. Apply a function. But &lt;strong&gt;do that quadrillions of times&lt;/strong&gt;, and you need serious hardware running flat-out for months.&lt;/p&gt;

&lt;p&gt;This is why training is categorically more power-hungry than simply using an AI. Inference, asking the model a question, is expensive too, but training is building the entire brain from scratch, not just consulting it.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why do the chips themselves burn so much power?
&lt;/h2&gt;

&lt;p&gt;The hardware doing AI training isn't your laptop processor. It's specialised chips called &lt;strong&gt;GPUs&lt;/strong&gt; (Graphics Processing Units) and, increasingly, purpose-built AI accelerators like NVIDIA's H100 or Google's Tensor Processing Units (TPUs).&lt;/p&gt;

&lt;p&gt;GPUs were originally designed for rendering video game graphics, a task that requires doing thousands of simple calculations simultaneously rather than a few complex ones sequentially. That same architecture turns out to be ideal for the matrix multiplications at the heart of neural network training. A single NVIDIA H100 GPU has a peak power draw of around 700 watts, roughly the same as a powerful microwave oven. But you don't train frontier models on one chip.&lt;/p&gt;

&lt;p&gt;Meta's Llama 3 training run reportedly used over 16,000 H100 GPUs. Running 16,000 chips at roughly 700 watts each means a peak demand approaching 11 megawatts for the chips alone, before you account for the cooling systems, networking hardware, storage, and facility infrastructure that keep everything running. Data centres typically consume as much energy on &lt;strong&gt;cooling as they do on computation&lt;/strong&gt;, which doubles the effective electricity bill.&lt;/p&gt;

&lt;p&gt;The measure engineers use for this overhead is called PUE: Power Usage Effectiveness. A PUE of 1.0 would mean every watt goes to computing. Real data centres typically run between 1.2 and 1.5, meaning for every watt of compute, another 0.2 to 0.5 watts goes to keeping the machines from melting.&lt;/p&gt;

&lt;p&gt;Scale this up across dozens of simultaneous training runs at major AI labs, and the numbers become genuinely difficult to comprehend.&lt;/p&gt;

&lt;h2&gt;
  
  
  How does training compare to just using AI?
&lt;/h2&gt;

&lt;p&gt;There's a critical distinction the headlines often blur: &lt;strong&gt;training&lt;/strong&gt; and &lt;strong&gt;inference&lt;/strong&gt; are two completely different electricity problems.&lt;/p&gt;

&lt;p&gt;Training is the one-time (or periodic) process of building the model from scratch. Inference is what happens when you type a question into ChatGPT and get an answer back. Training is like constructing a factory. Inference is running the factory every day.&lt;/p&gt;

&lt;p&gt;A single training run for a frontier model might consume thousands of megawatt-hours over several months. A single inference, one ChatGPT response, consumes a fraction of a watt-hour. But ChatGPT reportedly handles over 100 million users. Do the maths across billions of daily queries and inference starts adding up too, potentially rivalling training in total annual consumption for widely-deployed models.&lt;/p&gt;

&lt;p&gt;Researchers have pointed out an important nuance: the electricity costs aren't evenly distributed across time. Training hits the grid in concentrated bursts, massive sustained loads during a model's training run. Inference is more spread out, more predictable, but relentless. AI labs managing this at scale are essentially running small power utilities.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Training:&lt;/strong&gt; weeks to months, thousands of GPUs, concentrated grid impact&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Fine-tuning:&lt;/strong&gt; shorter runs adapting existing models, moderate power demand&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Inference:&lt;/strong&gt; continuous, billions of queries, cumulative impact rivals training over time&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The IEA estimated that a ChatGPT query uses roughly ten times as much electricity as a standard Google search, a figure that illustrates just how energy-intensive generative AI inference is compared to conventional search.&lt;/p&gt;

&lt;h2&gt;
  
  
  Are bigger models always more power-hungry?
&lt;/h2&gt;

&lt;p&gt;Here's where it gets counterintuitive. Bigger models don't always mean proportionally more power, and smaller models aren't always cheaper to run.&lt;/p&gt;

&lt;p&gt;The relationship between model size and energy cost is governed by &lt;strong&gt;scaling laws&lt;/strong&gt;, mathematical relationships that describe how model performance improves with more parameters, more data, and more compute. Research from DeepMind (published in what's known as the Chinchilla paper) showed that many of the largest models released before 2022 were actually undertrained, they'd used too many parameters relative to the amount of data they were trained on. A smaller, better-trained model could match or beat a larger, undertrained one at lower energy cost.&lt;/p&gt;

&lt;p&gt;This insight reshaped how labs design training runs. It doesn't eliminate the energy problem, but it does mean that raw model size is a poor proxy for energy consumption. A 70-billion-parameter model trained carefully on 2 trillion tokens might be more capable, and more energy-efficient per unit of performance, than a 175-billion-parameter model trained on less data.&lt;/p&gt;

&lt;p&gt;There's also the question of what happens after training. Models deployed at scale often get compressed through techniques like quantisation (reducing the numerical precision of weights) and distillation (training smaller models to mimic larger ones). These can dramatically reduce inference costs without significantly degrading performance.&lt;/p&gt;

&lt;p&gt;The uncomfortable reality, though, is that efficiency gains have historically been outpaced by demand growth. As models get cheaper to run, labs build bigger ones and deploy them more widely. Researchers call this &lt;strong&gt;Jevons' paradox&lt;/strong&gt; applied to AI: efficiency improvements tend to increase total consumption rather than reduce it.&lt;/p&gt;

&lt;h2&gt;
  
  
  What does AI's electricity appetite mean for the grid?
&lt;/h2&gt;

&lt;p&gt;Power grid operators in the United States, Ireland, and across Europe are already flagging AI data centres as a significant planning challenge. Ireland, which hosts major hyperscale data centres for Google, Meta, and Microsoft, saw its data centres consume roughly 21% of the country's total electricity in 2023, a figure that prompted EirGrid, the national grid operator, to warn about capacity constraints.&lt;/p&gt;

&lt;p&gt;In the United States, utilities in Virginia, home to the highest concentration of data centres on Earth, have begun revising their load forecasts dramatically upward. Dominion Energy, which serves northern Virginia, projected in 2024 that it would need to add significant new generation capacity over the coming decade, driven largely by AI and data centre growth.&lt;/p&gt;

&lt;p&gt;The response from AI companies has been varied. Microsoft announced a partnership with Constellation Energy to restart Three Mile Island's nuclear reactor in Pennsylvania specifically to power its data centres. Google has signed long-term power purchase agreements for geothermal energy. Amazon has invested in nuclear power startups. These moves signal that the industry itself recognises the electricity problem isn't abstract, it's a near-term operational constraint.&lt;/p&gt;

&lt;p&gt;The grid implication cuts both ways. More electricity demand can accelerate investment in new generation, including renewables. But in regions where the grid still relies heavily on fossil fuels, &lt;strong&gt;AI training runs are, right now, burning coal and gas&lt;/strong&gt;. The carbon footprint of a model depends enormously on where in the world it's trained, and at what time of year, a training run in Norway, powered by hydroelectricity, has a fraction of the carbon impact of the same run in a coal-heavy region.&lt;/p&gt;

&lt;h2&gt;
  
  
  Can AI training ever become truly efficient?
&lt;/h2&gt;

&lt;p&gt;The honest answer is: more efficient, yes. Truly efficient in any absolute sense, almost certainly not at the rate the industry is moving.&lt;/p&gt;

&lt;p&gt;There are genuine technical pathways to lower energy consumption. &lt;strong&gt;Neuromorphic chips&lt;/strong&gt;, hardware designed to mimic the brain's sparse, event-driven signalling, could theoretically perform AI computations at a fraction of current energy costs. Intel's Loihi 2 chip and IBM's research into neuromorphic architectures point in this direction, though they remain far from deployment at training scale.&lt;/p&gt;

&lt;p&gt;Alternative training methods are also gaining traction. Mixture-of-Experts (MoE) architectures, used in models like Google's Gemini, activate only a subset of the model's parameters for any given input. This means the full model is large on paper, but the active compute per query is much smaller, a meaningful efficiency gain.&lt;/p&gt;

&lt;p&gt;Better data curation is perhaps the most underappreciated lever. Research consistently shows that training on higher-quality, more carefully filtered data produces better models with less compute. If you can train a capable model on 500 billion tokens of excellent data rather than 2 trillion tokens of mixed-quality data, you've cut the energy bill dramatically.&lt;/p&gt;

&lt;p&gt;But none of these advances change the fundamental physics. Moving information through silicon at scale takes energy. Until we have room-temperature superconductors or some other physics-defying breakthrough, every forward pass and every backpropagation step will require electrons flowing through resistive circuits, generating heat, demanding cooling, and drawing from the grid. The question for the next decade isn't whether AI will use electricity. It's whether that electricity will be clean.&lt;/p&gt;

&lt;p&gt;The electricity demand of AI training isn't a bug or a PR problem. It's a direct consequence of how machine learning works: learning requires repetition, repetition requires computation, and computation requires power. The scale at which modern AI operates makes that power demand extraordinary. What changes when you understand this is how you think about AI's true cost. Every model released, every chatbot query, every image generated carries an invisible energy price tag. The industry is starting to face this, nuclear deals, renewable contracts, hardware innovations, but the trajectory is still upward. The grid is now, quietly, an AI infrastructure problem.&lt;/p&gt;




&lt;p&gt;&lt;em&gt;Originally published on &lt;a href="https://snackiq.app/blog/why-ai-training-actually-eats-your-grid" rel="noopener noreferrer"&gt;SnackIQ&lt;/a&gt;&lt;/em&gt;&lt;/p&gt;

</description>
      <category>howmuchelectricitydo</category>
      <category>aitrainingenergycons</category>
      <category>howmuchpowerdoesaius</category>
      <category>aielectricityusageex</category>
    </item>
    <item>
      <title>Why AI Actually Needs Your Bandwidth</title>
      <dc:creator>SnackIQ</dc:creator>
      <pubDate>Thu, 20 Aug 2026 14:03:00 +0000</pubDate>
      <link>https://dev.to/snackiq_app/why-ai-actually-needs-your-bandwidth-5e7b</link>
      <guid>https://dev.to/snackiq_app/why-ai-actually-needs-your-bandwidth-5e7b</guid>
      <description>&lt;p&gt;&lt;a href="https://[snackiq](https://snackiq.app/glossary/snackiq).app/glossary/ai-internet-bandwidth-requirements" rel="noopener noreferrer"&gt;AI internet bandwidth requirements&lt;/a&gt; are rarely what anyone expects. Most people assume chatting with an AI is like sending an email, lightweight, forgiving, barely touching your connection. It isn't. Every AI interaction you have involves shuttling data between your device and a remote data centre, often across thousands of miles of fibre-optic cable, in real time. According to industry benchmarks published by internet providers in 2024 and 2025, AI image generation tools like MidJourney and DALL·E recommend a minimum of 50 Mbps download speed, while AI video tools push that figure even higher. Even text-based tools like ChatGPT depend less on raw speed and more on latency, the invisible delay that makes responses feel instant or sluggish. Understanding why AI is so network-hungry changes how you think about your broadband plan.&lt;/p&gt;

&lt;h2&gt;
  
  
  What actually happens between you and an AI tool?
&lt;/h2&gt;

&lt;p&gt;Every time you type a prompt and hit enter, something surprisingly complex happens behind the scenes. Your message doesn't get processed on your laptop or phone, it travels across the internet to a remote server, gets fed into a large language model running on specialised hardware, and then the response travels all the way back. That round trip happens in seconds, sometimes less. But it's never free, in terms of bandwidth.&lt;/p&gt;

&lt;p&gt;For &lt;strong&gt;text-based AI tools&lt;/strong&gt; like ChatGPT or Claude, the data transferred per interaction is relatively small, a few kilobytes per query. What matters far more than raw download speed is &lt;strong&gt;latency&lt;/strong&gt;, measured in milliseconds. Latency is the time it takes for a signal to make that return journey. A connection with 25 Mbps download speed but 10ms latency will feel faster than a 100 Mbps connection with 80ms latency. This is why AI chatbots sometimes feel sluggish on congested networks even when your speed test looks fine.&lt;/p&gt;

&lt;p&gt;For AI tools that handle richer media, the equation shifts dramatically. AI image generators like Adobe Firefly or MidJourney receive your text prompt, tiny, but then return a high-resolution image file, often several megabytes in size. If you're iterating rapidly through versions, that bandwidth adds up fast. Industry guidance from internet service providers recommends a minimum of &lt;strong&gt;50 Mbps download and 10 Mbps upload&lt;/strong&gt; for smooth AI image generation workflows, rising to 100 Mbps or higher when working with cloud-based design tools simultaneously.&lt;/p&gt;

&lt;p&gt;AI video generation and real-time AI video analysis tools sit at the extreme end. These applications stream continuous data in both directions, your camera feed goes up, processed output comes back, creating sustained bandwidth demands that dwarf anything a text chatbot requires.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why does AI training consume so much more bandwidth than you'd expect?
&lt;/h2&gt;

&lt;p&gt;What you experience as a user is just the tip of the iceberg. The bandwidth consumed during AI model training, the process that happens before you ever interact with a model, is staggering by comparison.&lt;/p&gt;

&lt;p&gt;Training a large language model involves moving &lt;strong&gt;terabytes or even petabytes of data&lt;/strong&gt; between storage systems and compute clusters, repeatedly, over days or weeks. That data doesn't sit in one place. Modern AI training often spans multiple data centres across different geographic locations, meaning all that information has to travel across high-speed fibre links continuously. A single training run for a frontier-scale model can generate more data transfer than millions of ordinary users collectively produce in a day.&lt;/p&gt;

&lt;p&gt;There's also the question of &lt;strong&gt;federated learning&lt;/strong&gt;, a technique where AI models are trained across many distributed devices simultaneously, with each device sending model updates back to a central server rather than raw data. This approach was partly designed to reduce privacy risks, but it creates its own bandwidth overhead: all those update signals have to be synchronised constantly across a distributed network.&lt;/p&gt;

&lt;p&gt;Data centre interconnects, the high-throughput links that stitch together the infrastructure running your favourite AI tools, need to support speeds measured not in megabits but in &lt;strong&gt;terabits per second&lt;/strong&gt;. Industry analysts tracking data centre infrastructure have noted that AI workloads are driving fibre-optic network upgrades at a pace that outstrips historical demand growth from streaming video, which itself was considered a bandwidth revolution just a decade ago.&lt;/p&gt;

&lt;p&gt;The version of AI you interact with was shaped, in part, by a network infrastructure arms race you never saw.&lt;/p&gt;

&lt;h2&gt;
  
  
  How much bandwidth does each type of AI tool actually need?
&lt;/h2&gt;

&lt;p&gt;Not all AI tools hit your connection equally hard. The differences are wide enough that your broadband plan might genuinely be holding certain tools back while being entirely adequate for others.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;AI writing assistants&lt;/strong&gt; (ChatGPT, Jasper, Grammarly): As low as 5–25 Mbps. These tools transfer small amounts of text data. Latency matters far more than raw speed.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;AI image generators&lt;/strong&gt; (DALL·E, MidJourney, Adobe Firefly): 50 Mbps download minimum recommended, 100 Mbps or higher for professional workflows involving high-resolution outputs or collaborative cloud tools.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;AI research and data analysis tools&lt;/strong&gt;: Variable, but sustained throughput matters. Uploading large datasets for analysis can strain upload speeds, most home connections are asymmetric, with upload speeds a fraction of download speeds.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;AI video tools and real-time analytics&lt;/strong&gt;: 100 Mbps or higher, with particularly tight latency requirements. Real-time AI video processing is bidirectional, meaning your upload speed is just as critical as your download speed.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Edge AI devices&lt;/strong&gt; (smart cameras, drones, IoT sensors): These generate continuous data streams that must travel to cloud processing. A single high-resolution AI security camera can consume several Mbps of upload capacity around the clock.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The pattern is clear: the richer the media type, the heavier the bandwidth demand. &lt;strong&gt;Upload speed&lt;/strong&gt; is the surprising weak link for many users, home broadband packages historically prioritised download speeds, but AI tools that involve submitting images, video, or large documents reverse that priority.&lt;/p&gt;

&lt;p&gt;If you regularly use multiple AI tools simultaneously, which is increasingly common in professional workflows, these requirements stack. Two people in the same household running AI video calls and image generation concurrently can saturate a standard 100 Mbps connection.&lt;/p&gt;

&lt;h2&gt;
  
  
  What is latency and why do AI tools care so much about it?
&lt;/h2&gt;

&lt;p&gt;Speed and latency are not the same thing, and conflating them is one of the most common misunderstandings about AI internet performance.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Download speed&lt;/strong&gt; measures how much data can flow to your device per second. &lt;strong&gt;Latency&lt;/strong&gt; measures how long it takes for a single packet of data to make a round trip between your device and a server. A fibre connection might deliver 500 Mbps download speeds but still feel sluggish for AI tools if the routing adds 150ms of latency.&lt;/p&gt;

&lt;p&gt;For AI chatbots, low latency is what makes the interaction feel alive. When you type a message and the response appears token by token, word by word, that streaming effect depends on a sustained, low-latency connection. High latency doesn't just slow the first word; it introduces stutter throughout the entire response, making the tool feel broken even when it's technically functioning correctly.&lt;/p&gt;

&lt;p&gt;Geography plays a surprisingly large role here. If you're in rural Australia querying an AI model whose servers are in Virginia, the physical distance alone adds meaningful latency regardless of your connection quality. This is why major AI companies have been expanding their server footprints globally, getting compute closer to users reduces latency as much as any infrastructure upgrade.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Packet loss&lt;/strong&gt;, the percentage of data packets that fail to arrive and must be resent, is another hidden factor. Even 1–2% packet loss, which most speed tests don't prominently report, can make real-time AI applications noticeably worse. Tools that rely on a continuous bidirectional data stream are especially sensitive to packet loss because every dropped packet forces a retransmission that interrupts the flow.&lt;/p&gt;

&lt;p&gt;A useful rule of thumb: for AI tools, aim for latency below 50ms and packet loss below 0.5%. These figures matter more than headline megabit numbers for most text-based AI interactions.&lt;/p&gt;

&lt;h2&gt;
  
  
  Will AI make bandwidth problems worse over the next decade?
&lt;/h2&gt;

&lt;p&gt;The honest answer is yes, and the scale of the increase is worth understanding.&lt;/p&gt;

&lt;p&gt;AI workloads are already among the fastest-growing sources of internet traffic. Analysts tracking network infrastructure trends have noted that AI-driven demand is growing at rates that exceed the historical growth curves driven by video streaming, and video streaming transformed internet infrastructure almost beyond recognition between 2010 and 2020. AI is doing the same thing, faster.&lt;/p&gt;

&lt;p&gt;Several trends are compounding simultaneously. &lt;strong&gt;Edge AI&lt;/strong&gt;, running AI inference directly on devices like cameras, drones, vehicles, and sensors rather than in central data centres, is designed to reduce latency, but it shifts some of the bandwidth burden to the local network infrastructure connecting those devices. Smart city traffic systems, industrial IoT networks, and autonomous vehicle fleets all generate continuous AI-driven data flows that aggregate into serious network load.&lt;/p&gt;

&lt;p&gt;Multimodal AI tools, models that handle text, images, audio, and video together, are becoming standard. The bandwidth floor for interacting with these tools is higher than for single-modality text AI, by definition. As these tools become the norm rather than the exception, minimum recommended internet speeds will drift upward.&lt;/p&gt;

&lt;p&gt;Fibre-optic networks are the technology best positioned to meet this demand. Fibre's theoretical capacity far exceeds current AI bandwidth requirements and scales elegantly with future demand. Copper-based broadband infrastructure, still common in many markets, faces harder physical limits. In this sense, the AI bandwidth question is also quietly an argument for accelerating fibre rollout in underserved areas, regions with slow internet face a compounding disadvantage as AI tools become more central to work, education, and daily life.&lt;/p&gt;

&lt;p&gt;Your internet speed isn't just a convenience metric anymore. For an increasing number of people, it's an access question.&lt;/p&gt;

&lt;p&gt;AI internet bandwidth requirements aren't a technical footnote, they're the invisible infrastructure your AI experience is built on. Text chatbots are forgiving; image generators are demanding; real-time AI video tools are unforgiving. Latency matters as much as speed. Upload capacity matters as much as download. And the collective bandwidth appetite of AI is growing faster than the infrastructure designed to serve it. The next time an AI tool feels sluggish, the problem probably isn't the model. It's the pipe.&lt;/p&gt;




&lt;p&gt;&lt;em&gt;Originally published on &lt;a href="https://snackiq.app/blog/why-ai-actually-needs-your-bandwidth" rel="noopener noreferrer"&gt;SnackIQ&lt;/a&gt;&lt;/em&gt;&lt;/p&gt;

</description>
      <category>aiinternetbandwidthr</category>
      <category>howmuchbandwidthdoes</category>
      <category>internetspeedforaito</category>
      <category>aidatatransferspeed</category>
    </item>
    <item>
      <title>7 Ways AI Secretly Kills Your Internet Speed</title>
      <dc:creator>SnackIQ</dc:creator>
      <pubDate>Mon, 06 Jul 2026 14:02:59 +0000</pubDate>
      <link>https://dev.to/snackiq_app/7-ways-ai-secretly-kills-your-internet-speed-31el</link>
      <guid>https://dev.to/snackiq_app/7-ways-ai-secretly-kills-your-internet-speed-31el</guid>
      <description>&lt;p&gt;AI affects internet speed and bandwidth in ways most users never see — and the slowdown is already measurable. Global internet traffic has grown dramatically in recent years, and AI workloads are a significant driver. Cisco's annual internet reports have long tracked surges in data transfer tied to cloud computing; analysts now point to generative AI as the next major accelerant. Every time you use ChatGPT, Copilot, or an AI-powered recommendation engine, your device exchanges far more data than a typical web request. Multiply that across millions of simultaneous users, overloaded data centres, and background AI processes you never consciously triggered, and the result is network congestion that slows everyone down — including you.&lt;/p&gt;

&lt;h2&gt;
  
  
  1. Generative AI Sends Enormous Data Packets
&lt;/h2&gt;

&lt;p&gt;A standard Google search transfers roughly 5–10 kilobytes of data. A single ChatGPT conversation can transfer several hundred kilobytes — and that's just the text. Add image generation, code completion, or document analysis, and a single session can push multiple megabytes back and forth.&lt;/p&gt;

&lt;p&gt;This matters because &lt;strong&gt;bandwidth is a shared resource&lt;/strong&gt;. When thousands of employees at a single company run Microsoft Copilot simultaneously — processing spreadsheets, drafting emails, summarising meetings — the aggregate data load on their corporate internet connection can spike dramatically. IT teams at large organisations have reported needing to upgrade their bandwidth allocations significantly after deploying AI tools across departments.&lt;/p&gt;

&lt;p&gt;The underlying reason is architectural. Generative models like large language models don't just retrieve stored text — they compute responses token by token, requiring continuous back-and-forth communication between your device and a remote server. That's fundamentally different from loading a static webpage, which is a one-time fetch.&lt;/p&gt;

&lt;p&gt;For home users, the effect is subtler but real. A household with multiple people running AI assistants, AI-enhanced video calls, and smart home devices with embedded AI can saturate a standard broadband connection during peak hours. &lt;strong&gt;The data packets are bigger, more frequent, and less predictable&lt;/strong&gt; than traditional web traffic — and most routers weren't designed with this in mind.&lt;/p&gt;

&lt;h2&gt;
  
  
  2. Real-Time AI Demands Nearly Zero Latency
&lt;/h2&gt;

&lt;p&gt;Speed isn't just about how much data travels — it's about how fast each exchange completes. AI applications are unusually sensitive to &lt;strong&gt;latency&lt;/strong&gt;, the millisecond delay between sending a request and receiving a response.&lt;/p&gt;

&lt;p&gt;Chatbots, live transcription tools, and AI-powered customer service systems all require near-instantaneous round trips to remote servers. When latency climbs — due to network congestion, routing inefficiencies, or overloaded data centres — these applications noticeably degrade. Responses stutter. Transcriptions lag. The experience collapses.&lt;/p&gt;

&lt;p&gt;This creates a hidden pressure on internet infrastructure. To keep AI tools feeling responsive, &lt;strong&gt;traffic must be prioritised and routed efficiently&lt;/strong&gt; at every hop between your device and the AI's data centre. Most consumer internet connections don't guarantee that. They're best-effort services, which means during congested periods, your AI assistant's performance suffers first.&lt;/p&gt;

&lt;p&gt;Enterprises have responded by investing in dedicated low-latency fibre links and SD-WAN solutions that intelligently route AI traffic. But most individuals and small businesses are still on standard broadband, where a Netflix stream next door can push your AI tool's response time from 200 milliseconds to over a second — enough to make real-time features feel broken.&lt;/p&gt;

&lt;h2&gt;
  
  
  3. Background AI Processes Run Without Your Permission
&lt;/h2&gt;

&lt;p&gt;Here's the part that surprises most people. A significant portion of AI-related bandwidth consumption happens when you're not actively using an AI tool at all.&lt;/p&gt;

&lt;p&gt;Modern operating systems, browsers, and applications run &lt;strong&gt;background AI processes constantly&lt;/strong&gt;. Windows 11's Recall feature indexes your screen activity. Google Chrome's enhanced spell-check sends keystrokes to Google's servers. Smartphone keyboards with predictive AI sync models. Smart speakers poll cloud AI services every few seconds waiting for wake words.&lt;/p&gt;

&lt;p&gt;None of these send enormous individual packets. But their cumulative effect — across dozens of apps on multiple devices — adds a persistent baseline drain on your connection. Research into always-on IoT devices has consistently found that background network traffic from seemingly idle devices is far higher than users expect.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Smart TVs&lt;/strong&gt; with AI recommendation engines regularly ping content servers to update models&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Browser extensions&lt;/strong&gt; with AI features (grammar checkers, ad blockers using ML classification) generate continuous API calls&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Mobile apps&lt;/strong&gt; using on-device AI periodically sync updated model weights over Wi-Fi&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Cloud storage services&lt;/strong&gt; with AI organisation features scan and upload file metadata continuously&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The individual contribution of each is small. Together, they represent a meaningful slice of your monthly data usage — and they compete for bandwidth with everything else you're trying to do.&lt;/p&gt;

&lt;h2&gt;
  
  
  4. AI Data Centres Are Straining Backbone Networks
&lt;/h2&gt;

&lt;p&gt;Your home broadband connects to a local exchange, which connects to regional infrastructure, which ultimately feeds into global backbone networks — the high-capacity fibre cables that carry internet traffic between cities and countries. AI is stressing all of it.&lt;/p&gt;

&lt;p&gt;Data centres that power AI workloads require &lt;strong&gt;dramatically higher internal bandwidth&lt;/strong&gt; than traditional server farms. Training a large AI model moves petabytes of data between thousands of GPUs simultaneously. Inference — running the model to answer your query — still requires rapid communication between specialised hardware clusters. These operations generate network traffic that dwarfs conventional web hosting.&lt;/p&gt;

&lt;p&gt;As of the mid-2020s, hyperscale data centres operated by companies like Microsoft, Google, and Amazon are consuming growing fractions of regional electricity and network capacity. When these facilities cluster geographically — as they do in Northern Virginia, which handles an estimated 70% of the world's internet traffic — local backbone congestion becomes a real concern.&lt;/p&gt;

&lt;p&gt;The knock-on effect reaches consumers. &lt;strong&gt;Increased traffic between data centres and the internet backbone&lt;/strong&gt; means more contention at peering points — the locations where different networks exchange traffic. During peak AI usage periods, that congestion propagates outward, slowing connections for ordinary users who have nothing to do with AI at all.&lt;/p&gt;

&lt;h2&gt;
  
  
  5. AI Video and Image Generation Are Bandwidth Monsters
&lt;/h2&gt;

&lt;p&gt;Text-based AI is heavy. AI that generates visual content is in a completely different category.&lt;/p&gt;

&lt;p&gt;A single AI-generated image from a service like Midjourney or DALL-E can be 2–5 megabytes. A short AI-generated video clip — even 10–15 seconds — can exceed 50 megabytes. Multiply this by the millions of images generated daily across these platforms and you start to understand the scale. &lt;strong&gt;Visual AI generation has become one of the fastest-growing categories of internet traffic&lt;/strong&gt;, according to infrastructure analysts tracking data centre output.&lt;/p&gt;

&lt;p&gt;For creative professionals using AI image tools for client work, a single project session can consume gigabytes of bandwidth. For households with data-capped broadband contracts — still common in rural areas and some mobile plans — AI image tools can blow through monthly allowances in days.&lt;/p&gt;

&lt;p&gt;Video AI amplifies this further. Tools that enhance video resolution using AI (used by streamers and video editors), generate AI-powered B-roll, or animate still images are increasingly mainstream. Each operation requires the original file to upload, get processed on a remote server, and return as a larger output file. That's three bandwidth transactions per operation, not one.&lt;/p&gt;

&lt;p&gt;The consumer internet was designed for browsing and streaming — activities with predictable, one-directional data flows. AI creative tools reverse that assumption with large upstream uploads that stress connections in ways typical households have never encountered before.&lt;/p&gt;

&lt;h2&gt;
  
  
  6. Multimodal AI Multiplies Every Request
&lt;/h2&gt;

&lt;p&gt;Early AI chatbots handled text. Modern AI assistants handle text, images, audio, video, PDFs, spreadsheets, and live camera feeds — sometimes simultaneously. This shift to &lt;strong&gt;multimodal AI&lt;/strong&gt; doesn't just add features. It multiplies bandwidth consumption per interaction.&lt;/p&gt;

&lt;p&gt;Consider a single interaction with a modern AI assistant: you photograph a receipt on your phone, ask the AI to extract the data, cross-reference it with your calendar, and summarise the result. That one task involves uploading a multi-megabyte image, receiving structured data, making an API call to a calendar service, and receiving a synthesised text response. Four separate data exchanges for what feels like one question.&lt;/p&gt;

&lt;p&gt;GPT-4 Vision, Google Gemini's multimodal capabilities, and Apple Intelligence all follow this pattern. As AI assistants become embedded in more applications — and as users discover their ability to handle complex, multi-step tasks — the number of API calls per user session grows.&lt;/p&gt;

&lt;p&gt;Research into enterprise AI deployments has found that &lt;strong&gt;multimodal workloads can use three to five times the bandwidth&lt;/strong&gt; of text-only AI interactions. For IT departments that planned bandwidth upgrades based on early text-only AI adoption, the arrival of multimodal tools has repeatedly forced emergency capacity increases. Home users face the same problem, just without anyone to call when their connection crawls.&lt;/p&gt;

&lt;h2&gt;
  
  
  7. Everyone Uses AI at the Same Time
&lt;/h2&gt;

&lt;p&gt;The most underappreciated factor in how AI affects internet speed is the most basic: &lt;strong&gt;peak hour congestion&lt;/strong&gt;.&lt;/p&gt;

&lt;p&gt;AI tools follow human schedules. ChatGPT usage spikes during business hours in the US, Europe, and Asia-Pacific in overlapping waves. When millions of users simultaneously submit queries to the same cluster of data centres, those centres — and the network paths leading to them — hit capacity limits. OpenAI has been transparent about this, displaying warning messages about high server load during peak periods since the service launched in late 2022.&lt;/p&gt;

&lt;p&gt;This creates a paradox. The more useful AI becomes, the more people use it. The more people use it simultaneously, the slower it gets — for everyone. Traditional websites face this problem too, but they can cache content and serve identical pages to millions of users cheaply. AI generates a unique response to every query, which means there's no efficiency shortcut. Every user needs their own slice of compute and bandwidth.&lt;/p&gt;

&lt;p&gt;For consumers, this manifests as slower AI responses during 9am–11am and 2pm–4pm in major time zones. But the congestion also bleeds into general internet performance. &lt;strong&gt;Shared internet exchanges and backbone routes don't distinguish AI traffic from your video call or cloud backup&lt;/strong&gt; — when AI demand floods those pipes, everything slows. The slowdown you experience on a Tuesday afternoon might have nothing to do with what you're doing, and everything to do with what millions of others are asking an AI to do.&lt;/p&gt;

&lt;p&gt;AI's impact on internet speed is invisible by design. You don't see the data packets, the background API calls, or the backbone congestion — you just notice your connection feeling sluggish at inexplicable moments. But the mechanisms are real, measurable, and accelerating. Bandwidth demand from AI workloads is growing faster than infrastructure can keep up. Understanding that gives you something valuable: the ability to diagnose, adapt, and make informed choices about which AI tools you actually need running in the background — and which ones you can quietly switch off.&lt;/p&gt;




&lt;p&gt;&lt;em&gt;Originally published on &lt;a href="https://snackiq.app/blog/7-ways-ai-secretly-kills-your-internet-speed" rel="noopener noreferrer"&gt;SnackIQ&lt;/a&gt;&lt;/em&gt;&lt;/p&gt;

</description>
      <category>howaiaffectsinternet</category>
      <category>whyismyinternetslowb</category>
      <category>aibandwidthusageexpl</category>
      <category>doesaislowdowntheint</category>
    </item>
    <item>
      <title>Why AI Actually Needs Your GPU</title>
      <dc:creator>SnackIQ</dc:creator>
      <pubDate>Wed, 01 Jul 2026 08:03:09 +0000</pubDate>
      <link>https://dev.to/snackiq_app/why-ai-actually-needs-your-gpu-34n1</link>
      <guid>https://dev.to/snackiq_app/why-ai-actually-needs-your-gpu-34n1</guid>
      <description>&lt;p&gt;How AI uses graphics processing comes down to one brutal bottleneck: math. Specifically, massive amounts of matrix multiplication happening millions of times per second. Training a large AI model like GPT-4 requires performing quintillions of floating-point operations — and doing them fast enough to be useful. According to Stanford University's Human-Centered AI group, GPU performance has increased roughly 7,000 times since 2003, with price-per-performance improving 5,600-fold over the same period. That explosion didn't happen because someone wanted better video games. It happened because the architecture that makes GPUs brilliant at rendering pixels turns out to be almost perfectly suited to the core mathematical operations that power modern AI.&lt;/p&gt;

&lt;h2&gt;
  
  
  What does a GPU actually do differently?
&lt;/h2&gt;

&lt;p&gt;Most people think of a GPU as the thing that makes games look good. That's true — but the reason it makes games look good is the reason AI needs it so desperately.&lt;/p&gt;

&lt;p&gt;A &lt;strong&gt;Central Processing Unit (CPU)&lt;/strong&gt; is built for sequential processing. It has a small number of extremely powerful cores — typically between 8 and 64 in a high-end consumer chip — each capable of handling complex, varied tasks one after another. CPUs are generalists. They're brilliant at branching logic, running operating systems, and handling unpredictable workloads. What they're not built for is doing the same simple operation simultaneously across thousands of data points.&lt;/p&gt;

&lt;p&gt;A &lt;strong&gt;GPU does exactly that&lt;/strong&gt;. Where a top-of-the-line CPU might have 64 cores, a modern GPU like NVIDIA's H100 — the chip powering most serious AI infrastructure today — contains over 16,000 CUDA cores. These cores are simpler and slower individually, but they work in parallel. Ask a GPU to multiply a million pairs of numbers, and it doesn't queue them up — it handles enormous batches at once.&lt;/p&gt;

&lt;p&gt;Think of it this way. A CPU is a team of 10 brilliant surgeons. A GPU is a factory floor of 10,000 workers doing the same precise assembly step simultaneously. For the right job, the factory wins every time.&lt;/p&gt;

&lt;p&gt;The right job, it turns out, is almost all of AI. Neural networks are built on layers of matrix operations — multiplying grids of numbers together over and over, adjusting weights, passing results forward. This is exactly the kind of repetitive, parallel numerical work GPUs were designed to handle. Not metaphorically. Almost literally.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why does training an AI model need this much power?
&lt;/h2&gt;

&lt;p&gt;Training an AI model isn't like running a program. It's closer to running a program billions of times while constantly adjusting every variable inside it.&lt;/p&gt;

&lt;p&gt;When a model like ChatGPT is trained, it starts with essentially random internal settings — called &lt;strong&gt;weights and parameters&lt;/strong&gt;. The training process feeds it examples, measures how wrong its output is, then nudges every parameter slightly in the direction that reduces that error. This process, called backpropagation, requires calculating gradients across the entire network for every single training example. GPT-3 has 175 billion parameters. GPT-4's parameter count hasn't been officially confirmed, but estimates put it considerably higher.&lt;/p&gt;

&lt;p&gt;Each pass through the network — called a &lt;strong&gt;forward pass&lt;/strong&gt; — involves multiplying enormous matrices together across hundreds of layers. The subsequent backward pass, which computes the error gradients, requires doing it all again in reverse. Then the whole cycle repeats for the next training sample. Then the next. For weeks or months.&lt;/p&gt;

&lt;p&gt;The numbers are staggering. Training a large language model can require performing on the order of 10²³ floating-point operations — a number with 23 zeros. No CPU cluster could complete this in any practical timeframe. With thousands of GPUs running in parallel, it becomes merely expensive.&lt;/p&gt;

&lt;p&gt;This is why the biggest AI labs — Google DeepMind, OpenAI, Meta AI — operate data centres packed with tens of thousands of GPU chips running continuously. The GPUs aren't doing anything exotic. They're doing arithmetic. Just an almost incomprehensible amount of it, faster than any other hardware can.&lt;/p&gt;

&lt;h2&gt;
  
  
  What happens after training — does AI still need GPUs?
&lt;/h2&gt;

&lt;p&gt;Training gets most of the attention because it's so resource-intensive. But there's a second phase that matters just as much: &lt;strong&gt;inference&lt;/strong&gt; — the moment the AI is actually responding to you.&lt;/p&gt;

&lt;p&gt;Every time you send a message to an AI chatbot, ask an image generator for a picture, or get a recommendation from a streaming platform, the model is performing inference. It's running your input through its learned weights to produce an output. This is computationally lighter than training, but it's happening millions of times per second across millions of simultaneous users.&lt;/p&gt;

&lt;p&gt;For inference, the calculation profile is slightly different. The model isn't learning — it's just running forward through its network once per request. But the scale of demand means &lt;strong&gt;GPU efficiency becomes critical&lt;/strong&gt;. A single inference might take microseconds on a dedicated chip, but serving millions of users simultaneously requires parallelising those requests across GPU clusters.&lt;/p&gt;

&lt;p&gt;Companies like NVIDIA have responded by designing chips specifically optimised for inference workloads — lower precision arithmetic, faster memory bandwidth, smarter caching. The H100 chip, for instance, uses a new generation of Tensor Cores specifically engineered for the matrix operations that dominate both training and inference in transformer-based models.&lt;/p&gt;

&lt;p&gt;There's also a growing area of research around &lt;strong&gt;model quantisation&lt;/strong&gt; — compressing AI models so they can run on less powerful hardware, or even consumer-grade GPUs. This is what allows AI features to appear on laptops and smartphones. The core GPU dependency doesn't disappear; it just shifts down the hardware ladder.&lt;/p&gt;

&lt;h2&gt;
  
  
  Can't regular computers just run AI?
&lt;/h2&gt;

&lt;p&gt;This is the question most people arrive at eventually — and the answer is nuanced. It depends entirely on the scale of the task.&lt;/p&gt;

&lt;p&gt;Your laptop's processor can run small AI models. Consumer applications using compressed versions of language models — like some local AI tools — can function on a standard CPU, though slowly. What &lt;strong&gt;cannot&lt;/strong&gt; run on a standard CPU is the training of a large model, or the real-time inference of a frontier-scale model serving millions of users.&lt;/p&gt;

&lt;p&gt;Consider a rough comparison. A high-end consumer CPU might deliver around 1–2 teraflops of floating-point performance relevant to AI workloads. NVIDIA's H100 delivers around 2,000 teraflops for the specific low-precision operations AI relies on most. That's a difference of roughly three orders of magnitude — not a modest gap, but a chasm.&lt;/p&gt;

&lt;p&gt;Some companies are building alternative chips to challenge GPU dominance:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Google's TPUs (Tensor Processing Units)&lt;/strong&gt; — custom silicon designed specifically for neural network matrix operations, used internally across Google's AI products&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Cerebras Systems' Wafer-Scale Engine&lt;/strong&gt; — a chip the size of a dinner plate containing more transistors than any GPU&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Apple's Neural Engine&lt;/strong&gt; — integrated into M-series chips, enabling on-device AI inference for consumer features like Siri and image recognition&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;But GPUs remain dominant for one practical reason: the software ecosystem. NVIDIA's CUDA programming platform — launched in 2006 — gave researchers a way to write GPU code for non-graphics tasks. Decades of AI libraries, frameworks, and tooling were built on top of it. TensorFlow, PyTorch, and virtually every major AI framework are GPU-first by default. Switching to a different chip means rewriting enormous amounts of infrastructure. That's not impossible, but it's expensive and slow.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why does any of this actually matter to you?
&lt;/h2&gt;

&lt;p&gt;The GPU dependency at the heart of modern AI has consequences that ripple out far beyond data centres and research labs.&lt;/p&gt;

&lt;p&gt;First, there's the &lt;strong&gt;economics of AI access&lt;/strong&gt;. Because GPUs are scarce, expensive, and power-hungry, serious AI capability is concentrated in the hands of a small number of companies with the capital to build or rent GPU infrastructure. Training a frontier model can cost tens of millions of dollars in compute alone. That's not a regulatory barrier or a knowledge barrier — it's a hardware barrier. It shapes which organisations can compete in AI development.&lt;/p&gt;

&lt;p&gt;Second, there's the &lt;strong&gt;supply chain reality&lt;/strong&gt;. The vast majority of the world's most advanced AI-grade GPUs are manufactured by TSMC in Taiwan, using designs from NVIDIA and AMD. This concentration in a single geographic location creates geopolitical risks that governments are now spending hundreds of billions of dollars to address — including the US CHIPS Act and similar legislation in Europe and Japan.&lt;/p&gt;

&lt;p&gt;Third, there's the &lt;strong&gt;energy consequence&lt;/strong&gt;. GPUs running 24 hours a day consume enormous amounts of electricity. A single NVIDIA H100 GPU draws around 700 watts of power. A data centre with 10,000 of them draws 7 megawatts — enough to power several thousand homes. As AI workloads multiply, this demand is growing faster than the grid can easily accommodate.&lt;/p&gt;

&lt;p&gt;Understanding that AI runs on GPUs isn't a technical footnote. It explains why AI development is expensive, why certain companies dominate it, and why the environmental and geopolitical stakes of this technology are so high. The intelligence is in the model. But the model runs on hardware. And right now, that hardware is a GPU.&lt;/p&gt;

&lt;p&gt;The story of AI is usually told in terms of data, algorithms, and intelligence. But underneath all of that is silicon. Specifically, thousands of parallel processors doing matrix multiplication at inhuman speed. GPUs weren't designed for AI — they were designed for pixels. The fact that the two tasks share the same mathematical DNA is one of the luckier accidents in the history of computing. Next time you see an AI generate an image or finish your sentence, what you're actually witnessing is a graphics chip doing what it was always built to do — just pointed at a very different problem.&lt;/p&gt;




&lt;p&gt;&lt;em&gt;Originally published on &lt;a href="https://snackiq.app/blog/why-ai-actually-needs-your-gpu" rel="noopener noreferrer"&gt;SnackIQ&lt;/a&gt;&lt;/em&gt;&lt;/p&gt;

</description>
      <category>howdoesaiusegraphics</category>
      <category>whydoaisystemsneedgp</category>
      <category>gpuforaiexplained</category>
      <category>whatisagpuinai</category>
    </item>
    <item>
      <title>7 Shocking Ways AI Drains Your Power Grid</title>
      <dc:creator>SnackIQ</dc:creator>
      <pubDate>Mon, 29 Jun 2026 14:02:18 +0000</pubDate>
      <link>https://dev.to/snackiq_app/7-shocking-ways-ai-drains-your-power-grid-448k</link>
      <guid>https://dev.to/snackiq_app/7-shocking-ways-ai-drains-your-power-grid-448k</guid>
      <description>&lt;p&gt;&lt;a href="https://[snackiq](https://snackiq.app/glossary/snackiq).app/glossary/how-much-electricity-does-training-ai-models-use" rel="noopener noreferrer"&gt;How much electricity does training AI models use&lt;/a&gt;? Enough to matter to your grid, your climate, and eventually your utility bill. In 2023, US data centres consumed 4.4% of the country's entire electricity supply, according to the Lawrence Berkeley National Laboratory — a figure that analysts warn could triple by 2028. AI isn't the only thing running inside those data centres, but it's the fastest-growing tenant, and its appetite is unlike anything the energy industry has planned for. The chips that power AI run hotter, harder, and longer than conventional server hardware. And most of what AI consumes happens invisibly, humming away in windowless buildings far from where you type your prompts.&lt;/p&gt;

&lt;h2&gt;
  
  
  1. Training a Single Model Burns What a Town Uses
&lt;/h2&gt;

&lt;p&gt;The headline number is staggering. Researchers at the University of Massachusetts Amherst estimated that training a large transformer model from scratch can emit as much carbon as five average American cars over their entire lifetimes — and that's just the carbon equivalent. The raw electricity involved is similarly extreme.&lt;/p&gt;

&lt;p&gt;When OpenAI trained GPT-3, reports at the time estimated the process required millions of kilowatt-hours of electricity. A single kilowatt-hour powers a 100-watt bulb for ten hours. Scale that up and you're looking at the consumption of a small town, compressed into weeks of nonstop GPU computation. GPT-4, which is larger and more capable, almost certainly required significantly more.&lt;/p&gt;

&lt;p&gt;This matters because &lt;strong&gt;training is a one-time event that enables billions of interactions&lt;/strong&gt;. But the scale of that one-time event is often invisible to users. You see a chat interface. Behind it sits months of electricity bills that no single individual ever receives.&lt;/p&gt;

&lt;p&gt;The training phase involves running thousands of specialised chips called GPUs or TPUs in parallel, 24 hours a day, for weeks or months. Each chip draws hundreds of watts. Multiply by thousands of chips, then by weeks, and the arithmetic gets uncomfortable fast.&lt;/p&gt;

&lt;h2&gt;
  
  
  2. Every Question You Ask Costs Real Electricity
&lt;/h2&gt;

&lt;p&gt;Training is the dramatic headline, but &lt;strong&gt;inference — the act of AI answering your questions — is where the sustained energy cost lives&lt;/strong&gt;. Every time you ask a chatbot something, a data centre runs a complex mathematical operation across billions of parameters. That operation costs electricity. Small per query. Enormous in aggregate.&lt;/p&gt;

&lt;p&gt;Researchers have estimated that a single ChatGPT query uses roughly ten times the electricity of a standard Google search. Google processes hundreds of billions of searches per year. ChatGPT reportedly reached 100 million users within two months of launch — the fastest consumer app to do so. Multiply those users by their daily queries, and the inference load becomes a continuous, massive draw on the grid.&lt;/p&gt;

&lt;p&gt;Penn State's Institute for Energy and the Environment notes that AI inference — not just training — is now a significant and growing portion of data centre energy consumption. Unlike training, which ends when the model is ready, inference never stops. It runs every second of every day, across every product that uses AI.&lt;/p&gt;

&lt;p&gt;This is the quiet electricity cost: not the dramatic training sprint, but the endless, invisible marathon of answering questions, generating images, summarising documents, and autocompleting emails — all day, every day, at planetary scale.&lt;/p&gt;

&lt;h2&gt;
  
  
  3. The Chip Inside AI Is an Energy Monster
&lt;/h2&gt;

&lt;p&gt;Standard computer chips are designed to handle varied workloads efficiently. AI chips are designed to do one thing — matrix multiplication — at extraordinary speed. That narrow specialisation makes them devastatingly fast at AI tasks. It also makes them power-hungry in ways conventional chips are not.&lt;/p&gt;

&lt;p&gt;NVIDIA's H100 GPU, which has become the dominant chip for AI training, draws up to &lt;strong&gt;700 watts of power under full load&lt;/strong&gt;. A high-end gaming PC typically draws 300–400 watts in total. A data centre doesn't run one H100. It runs thousands, sometimes tens of thousands, stacked in racks designed specifically to handle the thermal load.&lt;/p&gt;

&lt;p&gt;The physics here is unforgiving. More computation means more heat. More heat requires more cooling. Cooling systems themselves consume electricity. So the energy cost of AI isn't just the chips — it's the industrial-scale air conditioning, water cooling loops, and airflow management systems required to stop those chips from melting.&lt;/p&gt;

&lt;p&gt;According to analysis from the Lawrence Berkeley National Laboratory, cooling alone can account for 30–40% of a data centre's total energy consumption. In AI-optimised facilities, that proportion may be even higher. When you're cooling chips that run hotter than a car engine, the energy overhead compounds quickly.&lt;/p&gt;

&lt;h2&gt;
  
  
  4. Big Tech's Electricity Pledges Are Getting Harder to Keep
&lt;/h2&gt;

&lt;p&gt;Microsoft, Google, and Amazon all made high-profile commitments to run on 100% renewable energy. Those pledges were credible when AI was a minor part of their operations. The rapid expansion of AI workloads is now testing them in ways no one fully anticipated.&lt;/p&gt;

&lt;p&gt;Microsoft's 2024 environmental report revealed that its carbon emissions had actually increased significantly compared to its 2020 baseline — largely attributable to data centre construction and the electricity demands of AI infrastructure. Google reported a similar trend: its emissions rose as AI compute demands outpaced the pace of renewable energy procurement.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;The core problem is timing.&lt;/strong&gt; Renewable energy sources like solar and wind don't always generate power when AI data centres need it most. Grid operators use a mix of sources, and when renewables fall short, fossil fuels fill the gap. A company can purchase renewable energy certificates, but the electrons entering their facilities at 2am on a cloudy, calm night may come from a coal plant.&lt;/p&gt;

&lt;p&gt;This creates a gap between corporate sustainability reporting and physical reality. The electricity grid doesn't care about pledges. It delivers whatever mix of sources is available at any given moment, and AI's 24/7 demand means it draws from the grid around the clock — regardless of whether the sun is shining.&lt;/p&gt;

&lt;h2&gt;
  
  
  5. The Grid Wasn't Built for This Demand
&lt;/h2&gt;

&lt;p&gt;Power grids are engineered around predictable demand curves. Residential electricity peaks in the morning and evening. Industrial demand is fairly stable during business hours. Data centres have traditionally been large but manageable loads, distributed across regions.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;AI data centres break this model.&lt;/strong&gt; They demand massive, consistent power — not just during business hours but continuously. A facility training a large model may draw 50–100 megawatts around the clock for months. That's equivalent to the constant power demand of a small city, concentrated at a single grid connection point.&lt;/p&gt;

&lt;p&gt;Grid operators in Virginia — home to the highest concentration of data centres in the world — have flagged AI expansion as a significant planning challenge. The region, known as Data Centre Alley, is home to facilities that collectively consume more electricity than many US states. Utility companies are scrambling to plan new transmission infrastructure, and some have warned of potential reliability issues if AI growth outpaces grid upgrades.&lt;/p&gt;

&lt;p&gt;Similar concerns have emerged in Ireland, the Netherlands, and Singapore, where data centre density is high and grid capacity is constrained. In some cases, governments have imposed temporary moratoriums on new data centre construction while infrastructure catches up. The electricity bill isn't just abstract — it shows up as grid stress, which can affect prices and reliability for everyone connected.&lt;/p&gt;

&lt;h2&gt;
  
  
  6. The Race to Efficiency Is Real — But Barely Keeping Pace
&lt;/h2&gt;

&lt;p&gt;The AI industry isn't ignoring this problem. Efficiency improvements are genuine, measurable, and happening fast. But the question is whether they're happening fast enough.&lt;/p&gt;

&lt;p&gt;Google's DeepMind team used AI to reduce the company's data centre cooling energy by around 40% — a striking demonstration of AI solving its own environmental problems. Chip manufacturers are releasing more power-efficient architectures with each generation. Techniques like model quantisation (reducing the precision of calculations without sacrificing much accuracy) and distillation (training smaller models to mimic larger ones) are making inference significantly cheaper per query.&lt;/p&gt;

&lt;p&gt;Meta and others have open-sourced efficient smaller models like the LLaMA family, which can run on consumer hardware rather than giant data centres. Researchers at Stanford and elsewhere are developing &lt;strong&gt;sparse models&lt;/strong&gt; that activate only the relevant parts of a neural network for any given task, dramatically reducing unnecessary computation.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Model quantisation: compresses models to use less memory and compute- Knowledge distillation: trains small, fast models using large models as teachers- Sparse activation: only fires the neurons relevant to the current task- Specialised hardware: chips designed for inference, not just training&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;But here's the catch: efficiency gains historically trigger more usage. When computing becomes cheaper, demand rises to fill the available capacity. This pattern — known as Jevons' paradox — has played out in computing repeatedly. Cheaper AI inference may simply mean more AI inference, not less total energy consumed.&lt;/p&gt;

&lt;h2&gt;
  
  
  7. Your Electricity Bill Already Reflects AI's Appetite
&lt;/h2&gt;

&lt;p&gt;This might feel abstract until you look at electricity demand forecasts. The International Energy Agency projected in 2024 that global data centre electricity consumption could double by 2026. Utilities in AI-heavy regions are already planning rate adjustments to fund grid upgrades.&lt;/p&gt;

&lt;p&gt;In the United States, grid operators like PJM Interconnection — which covers 13 states including major data centre hubs — have revised their long-term demand forecasts dramatically upward, citing AI as the primary driver. Building new transmission lines, substations, and generation capacity costs money. That cost flows through to ratepayers.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;It's not hypothetical.&lt;/strong&gt; Some US utilities have already filed for rate increases partly justified by data centre-driven infrastructure investment. Residents in Virginia and Texas — two of the largest data centre markets — are beginning to see the downstream effects of a demand surge that most people associate only with tech companies' server farms.&lt;/p&gt;

&lt;p&gt;The deeper irony is that AI is simultaneously being developed to optimise energy systems, reduce waste, and accelerate the green energy transition. Some of the most promising applications of large language models involve modelling climate systems, designing better batteries, and optimising renewable energy grids. AI might ultimately help solve the energy problem it's currently making worse. But that future is measured in decades. The electricity it consumes is measured in megawatts, right now, today.&lt;/p&gt;

&lt;p&gt;The electricity AI consumes isn't a bug in the technology — it's a direct consequence of what makes it powerful. Processing billions of parameters requires billions of calculations, and calculations require power. What changes when you understand this is how you think about 'free' AI tools. Nothing about them is free. The cost is measured in kilowatt-hours, grid stress, and carbon emissions that are real and growing. The next decade will determine whether the efficiency gains outrun the demand growth. Right now, it's a close race — and the grid is feeling every stride.&lt;/p&gt;




&lt;p&gt;&lt;em&gt;Originally published on &lt;a href="https://snackiq.app/blog/7-shocking-ways-ai-drains-your-power-grid" rel="noopener noreferrer"&gt;SnackIQ&lt;/a&gt;&lt;/em&gt;&lt;/p&gt;

</description>
      <category>howmuchelectricitydo</category>
      <category>aienergyconsumption</category>
      <category>aielectricityusage</category>
      <category>howdoesaiaffecttheen</category>
    </item>
    <item>
      <title>Why AI Actually Gets Worse With More Data</title>
      <dc:creator>SnackIQ</dc:creator>
      <pubDate>Tue, 23 Jun 2026 14:03:13 +0000</pubDate>
      <link>https://dev.to/snackiq_app/why-ai-actually-gets-worse-with-more-data-2nbi</link>
      <guid>https://dev.to/snackiq_app/why-ai-actually-gets-worse-with-more-data-2nbi</guid>
      <description>&lt;p&gt;More data should make AI smarter. That's the intuition almost everyone carries — feed the machine more, get better results. But researchers at Google, DeepMind, and Stanford have repeatedly found the opposite happening. Past a certain threshold, adding low-quality data to AI training doesn't improve a model's performance; it actively degrades it. A 2022 analysis of large language models found that models trained on aggressively filtered datasets consistently outperformed models trained on datasets ten times larger but less curated. The mechanism isn't mysterious once you understand it. AI doesn't absorb data the way a human brain files away experience. It finds statistical patterns — and the more noise you pour in, the more confidently it learns the wrong ones.&lt;/p&gt;

&lt;h2&gt;
  
  
  What is overfitting and why does it quietly break AI?
&lt;/h2&gt;

&lt;p&gt;Overfitting is one of the oldest problems in machine learning, and it's still one of the most misunderstood. It happens when a model learns its training data so thoroughly that it stops generalising to new situations.&lt;/p&gt;

&lt;p&gt;Think of it this way. Imagine you studied for an exam using only one textbook. You memorise every sentence, every footnote, every oddly-worded example question. Then the real exam uses different phrasing, different examples, a slightly different structure. You fail — not because you learned too little, but because you learned the specific source material instead of the underlying principles.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;AI models do exactly this&lt;/strong&gt;, and more data makes it worse, not better. When a dataset is large but full of redundant or noisy examples, the model doesn't learn the underlying signal more clearly. It learns the specific quirks and statistical artefacts of that dataset with increasing precision.&lt;/p&gt;

&lt;p&gt;Research from MIT and other leading institutions has shown that even small amounts of irrelevant or mislabelled data can measurably decrease model accuracy on real-world tasks. The model isn't dumb — it's doing exactly what it was designed to do. It's just optimising for the wrong thing.&lt;/p&gt;

&lt;p&gt;In practice, &lt;strong&gt;overfitting shows up as overconfidence&lt;/strong&gt;. A model trained on too much noisy data will give a wrong answer with far more certainty than a well-trained model would give a correct one. That's a deeply counterintuitive failure mode: the more data you add, the more wrong and the more sure the system becomes.&lt;/p&gt;

&lt;h2&gt;
  
  
  How data poisoning silently corrupts AI from the inside
&lt;/h2&gt;

&lt;p&gt;Overfitting is an accidental problem. &lt;strong&gt;Data poisoning&lt;/strong&gt; is an intentional one — and it's increasingly a real-world threat.&lt;/p&gt;

&lt;p&gt;Data poisoning occurs when bad actors deliberately inject corrupted, biased, or misleading examples into a training dataset. Because modern AI systems scrape enormous volumes of data from the internet, they're particularly vulnerable. Researchers at Carnegie Mellon University demonstrated that by modifying as little as 0.1% of a training dataset, an attacker could cause a model to consistently misclassify specific inputs — while performing perfectly normally on everything else.&lt;/p&gt;

&lt;p&gt;That 0.1% figure is what makes this so alarming. You don't need to corrupt most of the data. You need to corrupt the right data, strategically placed, so the model anchors to a false pattern it will never question.&lt;/p&gt;

&lt;p&gt;The attack surface is vast. Any AI trained on scraped web content — which includes virtually every major large language model — ingests forum posts, blog articles, social media text, and user-generated content at massive scale. It's essentially impossible to manually verify every training example at that volume.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Backdoor attacks&lt;/strong&gt; embed hidden triggers that cause specific misbehaviour on command&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Label flipping&lt;/strong&gt; mislabels training examples to skew the model's categorisation&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Gradient-based attacks&lt;/strong&gt; craft inputs specifically designed to maximise model confusion&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The uncomfortable truth is that we often can't tell when a deployed AI has been poisoned. It passes its benchmarks. It performs well on clean test sets. The failure only surfaces in the specific circumstances the attacker designed it for.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why noise accumulates faster than signal at scale
&lt;/h2&gt;

&lt;p&gt;Here's a physics-style intuition that helps. Imagine a radio signal. At low volume, you can hear the broadcast clearly. Turn up the amplifier and the signal gets louder — but so does every background hiss, electrical interference, and stray frequency. Past a certain point, more amplification produces more noise, not more clarity.&lt;/p&gt;

&lt;p&gt;Training data works the same way. Every new data source you add to a training corpus brings its own &lt;strong&gt;statistical noise&lt;/strong&gt; — mislabelled examples, formatting inconsistencies, cultural biases, outdated information, and duplicate content with slight variations that confuse the model.&lt;/p&gt;

&lt;p&gt;At small scales, the genuine signal dominates. At large scales — billions of training examples — the noise accumulates faster than the signal because high-quality, reliable information is relatively rare on the internet. Most web content is repetitive, poorly sourced, or actively misleading.&lt;/p&gt;

&lt;p&gt;A landmark paper from researchers at Google Brain showed that a carefully filtered dataset of roughly 300 billion tokens outperformed models trained on raw datasets multiple times larger. The difference wasn't architectural. It was purely in data curation. They had systematically removed duplicates, low-quality text, and near-miss mislabels before training began.&lt;/p&gt;

&lt;p&gt;This has a name in the field: &lt;strong&gt;the quality-quantity trade-off&lt;/strong&gt;. And the research consistently shows that quality wins. An AI trained on 10 million excellent examples routinely outperforms one trained on 10 billion mediocre ones — sometimes dramatically.&lt;/p&gt;

&lt;h2&gt;
  
  
  Does this mean AI has a data ceiling?
&lt;/h2&gt;

&lt;p&gt;Sort of — but the ceiling isn't fixed. It's a function of data quality rather than quantity alone.&lt;/p&gt;

&lt;p&gt;The concept researchers discuss is &lt;strong&gt;diminishing returns on data&lt;/strong&gt;. Early in training, each new example teaches the model something genuinely new. The model's performance improves steeply. But as the dataset grows, new examples increasingly duplicate patterns the model already knows. Performance gains flatten. Eventually, adding more data — especially low-quality data — actively introduces contradictions and noise that erode previously learned patterns.&lt;/p&gt;

&lt;p&gt;This is one reason why some of the most capable AI models in specific domains are smaller and more focused, not larger and more general. Medical AI systems trained on curated clinical datasets often outperform general-purpose models on medical tasks, despite being a fraction of the size.&lt;/p&gt;

&lt;p&gt;There's also a temporal dimension worth understanding. The web isn't static. Data scraped in 2020 contains information that contradicts data scraped in 2024. If both are included without careful versioning, the model learns conflicting facts simultaneously — and resolves the conflict by picking whichever pattern appears more frequently, not whichever is more accurate.&lt;/p&gt;

&lt;p&gt;OpenAI, Anthropic, and Google have all invested heavily in &lt;strong&gt;data curation pipelines&lt;/strong&gt; — automated systems that filter, deduplicate, and quality-score training data before it ever reaches the model. The competitive advantage in modern AI isn't raw compute or raw data volume. It's the quality of the filtering process that happens before training begins.&lt;/p&gt;

&lt;h2&gt;
  
  
  What this actually means for the AI you use every day
&lt;/h2&gt;

&lt;p&gt;This isn't just an academic concern. The degradation patterns described above show up in ways you've almost certainly already experienced.&lt;/p&gt;

&lt;p&gt;When a chatbot confidently gives you wrong information — and wrong with total certainty — that's often &lt;strong&gt;overfitting in action&lt;/strong&gt;. The model has learned a high-confidence statistical pattern that happens to be incorrect in your specific context. It doesn't know it doesn't know.&lt;/p&gt;

&lt;p&gt;When an AI recommendation system starts surfacing increasingly irrelevant content over time, that's often noise accumulation. The model has been updated with new user data that diluted the clean signal in its original training.&lt;/p&gt;

&lt;p&gt;When an image recognition system misidentifies a specific type of photo in a way that seems bizarre and systematic, that's frequently the fingerprint of a data poisoning event — deliberate or accidental — in the training pipeline.&lt;/p&gt;

&lt;p&gt;The broader implication is this: &lt;strong&gt;AI systems require ongoing curation, not just ongoing expansion&lt;/strong&gt;. The assumption that more data automatically equals better performance has driven some of the biggest misallocations in AI development history. Companies scraped the entire internet and were surprised when their models learned the internet's worst habits along with its best.&lt;/p&gt;

&lt;p&gt;For users, this creates a practical heuristic. An AI tool trained on a smaller, carefully maintained dataset for your specific use case will usually outperform a general-purpose system for that task. Specialisation, in AI as in human expertise, tends to beat scale.&lt;/p&gt;

&lt;p&gt;The counterintuitive truth about AI is that it doesn't hunger for data the way we assume. It hungers for signal — and most data is noise. The race to scrape the entire internet, tag everything, and throw it all at a model has produced systems that are simultaneously impressive and weirdly brittle. The next generation of AI won't be built by collecting more. It'll be built by filtering better. That reframe matters: the bottleneck in AI isn't data volume. It's wisdom about which data to trust.&lt;/p&gt;




&lt;p&gt;&lt;em&gt;Originally published on &lt;a href="https://snackiq.app/blog/why-ai-actually-gets-worse-with-more-data" rel="noopener noreferrer"&gt;SnackIQ&lt;/a&gt;&lt;/em&gt;&lt;/p&gt;

</description>
      <category>whydoesaigetworse</category>
      <category>aimodeldegradationex</category>
      <category>toomuchdataaiproblem</category>
      <category>aitrainingdataqualit</category>
    </item>
    <item>
      <title>Why AI Actually Needs Your Personal Data</title>
      <dc:creator>SnackIQ</dc:creator>
      <pubDate>Mon, 22 Jun 2026 08:02:12 +0000</pubDate>
      <link>https://dev.to/snackiq_app/why-ai-actually-needs-your-personal-data-4237</link>
      <guid>https://dev.to/snackiq_app/why-ai-actually-needs-your-personal-data-4237</guid>
      <description>&lt;p&gt;&lt;a href="https://[snackiq](https://snackiq.app/glossary/snackiq).app/glossary/how-does-ai-use-personal-data" rel="noopener noreferrer"&gt;How does AI use personal data&lt;/a&gt;? The short answer: it needs it to function at all. AI systems — from chatgpts to recommendation engines to fraud detectors — learn by ingesting enormous quantities of human-generated text, behaviour, and preference data. According to Stanford HAI researchers Jennifer King and Caroline Meinhardt, the defining feature of the current AI boom isn't just that data is being collected, it's the sheer scale. AI systems are so data-hungry that previously benign information — your search history, your writing style, your location patterns — becomes sensitive when combined. A 2025 report from the National Cybersecurity Alliance found that 65% of people are concerned about AI-related privacy risks, yet 58% have received no training on how to use AI tools safely. That gap between concern and understanding is exactly where the real risk lives.&lt;/p&gt;

&lt;h2&gt;
  
  
  What does AI actually do with your data?
&lt;/h2&gt;

&lt;p&gt;Most people imagine AI 'taking' their data the way a thief takes a wallet. The reality is stranger and more structural than that.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;AI systems don't store your data the way a database does.&lt;/strong&gt; Instead, they use it to adjust billions of internal mathematical weights during a process called training. Each piece of data — a sentence you wrote, a product you clicked, a route you drove — nudges those weights slightly, improving the model's ability to predict what comes next. Once training is complete, the original data isn't sitting in a folder somewhere. It's been dissolved into the model's parameters, like salt into water.&lt;/p&gt;

&lt;p&gt;But that analogy has a disturbing implication. Just as you can sometimes recover salt from water, researchers have shown that AI models can sometimes reproduce fragments of their training data when prompted in specific ways. This phenomenon, called &lt;strong&gt;memorisation&lt;/strong&gt;, means private information — medical records, personal emails, proprietary documents — can theoretically be extracted from a model that was trained on it.&lt;/p&gt;

&lt;p&gt;There are two distinct stages where your data matters:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Training:&lt;/strong&gt; The model learns patterns from massive datasets scraped from the web, licensed databases, and user-generated content.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Inference:&lt;/strong&gt; When you actively use an AI tool, your prompts and interactions may be logged, used to fine-tune the model, or shared with third parties depending on the platform's terms.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Most people only worry about the second stage. But the first — the training data stage — is where the most invisible and wide-ranging privacy implications occur. You may never have used ChatGPT, and your data could still be inside it.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why does AI need so much personal data specifically?
&lt;/h2&gt;

&lt;p&gt;Generic data isn't enough. That's the uncomfortable truth most AI companies don't advertise.&lt;/p&gt;

&lt;p&gt;To build a model that understands human language, intent, and context, you need data that reflects the full messy diversity of how humans actually communicate. That means slang, regional idioms, emotional register, implicit cultural references, and everything in between. &lt;strong&gt;Personal data is disproportionately valuable&lt;/strong&gt; because it contains this texture. Anonymised datasets tend to be cleaned, formal, and stripped of the nuance that makes AI systems feel intelligent.&lt;/p&gt;

&lt;p&gt;Recommendation engines face an even starker dependency. Netflix, Spotify, and TikTok don't just need to know what content exists — they need to know what you, specifically, responded to at 11pm on a Tuesday after a bad day. That requires &lt;strong&gt;longitudinal personal behavioural data&lt;/strong&gt;: not a snapshot, but a movie of your habits over time. The longer the observation window, the more accurate the predictions.&lt;/p&gt;

&lt;p&gt;Medical AI offers perhaps the clearest example. A model trained to detect early-stage cancer from scans needs thousands of confirmed cases across different demographics, imaging equipment types, and disease presentations. There's no synthetic substitute that fully replicates real patient data. The model's accuracy is literally a function of how much genuine personal medical data it was trained on.&lt;/p&gt;

&lt;p&gt;This is why Stanford HAI's researchers describe AI systems as operating in a 'data-centric world' — one where personal information isn't an input, it's the raw material. And unlike oil, which gets used up, data can be copied and used indefinitely, which changes the economics and ethics of the whole enterprise dramatically.&lt;/p&gt;

&lt;h2&gt;
  
  
  Where does the data actually come from?
&lt;/h2&gt;

&lt;p&gt;The sourcing of AI training data is one of the least transparent parts of the industry. Most large language models were trained on datasets assembled from the open web — forum posts, Wikipedia articles, news archives, Reddit threads, blog comments, legal filings, and academic papers. Common Crawl, a nonprofit that archives the web, is one of the most commonly cited sources for large-scale training data.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;The problem is that the web isn't anonymous.&lt;/strong&gt; It contains real names, real conversations, real medical questions asked on health forums, real personal disclosures made in comment sections. Much of this data was shared publicly in context — a Reddit post about mental health was written for that community, not to train a commercial AI product.&lt;/p&gt;

&lt;p&gt;Beyond web scraping, AI companies source data through:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Data brokers who aggregate and sell consumer profiles&lt;/li&gt;
&lt;li&gt;Licensing deals with media organisations and publishers&lt;/li&gt;
&lt;li&gt;User interactions on their own platforms (your ChatGPT conversations, by default, contributed to model improvements until OpenAI introduced opt-out settings)&lt;/li&gt;
&lt;li&gt;Synthetic data generation — where AI creates new training data based on existing data, which critics argue simply launders the original privacy issues&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;According to IBM's analysis of AI privacy issues, one of the sharpest emerging risks is &lt;strong&gt;data aggregation&lt;/strong&gt;: the combining of individually harmless datasets to create a profile that reveals far more than any single source would. Your name from one dataset, your location from another, your browsing habits from a third — merged, they form something far more invasive than any piece on its own. AI is exceptionally good at this kind of combination, which is precisely what makes it a new category of privacy challenge rather than just a scaled-up version of old ones.&lt;/p&gt;

&lt;h2&gt;
  
  
  What are the real privacy risks you're exposed to?
&lt;/h2&gt;

&lt;p&gt;Most privacy risks from AI aren't dramatic. They're cumulative and structural, which makes them harder to see and harder to fight.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Inference attacks&lt;/strong&gt; are among the most insidious. An AI model trained on your behaviour can infer things you never disclosed: your approximate income, your health conditions, your political leanings, your sexual orientation. Research has demonstrated that seemingly trivial data — the timing of your phone usage, the emoji patterns in your texts — can be used to infer emotional states and psychological traits. You didn't tell the algorithm anything. It figured it out.&lt;/p&gt;

&lt;p&gt;Then there's the question of what happens when you talk to an AI directly. When you type a prompt into an AI chatbot at work — asking it to summarise a confidential document, draft an email containing client details, or help with a medical question — that text may be stored, reviewed by human contractors for quality control purposes, or used in future training. The National Cybersecurity Alliance's 2025 data found that employees frequently expose sensitive company information this way, often without realising it.&lt;/p&gt;

&lt;p&gt;The legal landscape adds another layer of uncertainty. Law enforcement agencies in several countries have sought access to AI query logs. Depending on the jurisdiction and the platform's terms of service, &lt;strong&gt;your prompts may not be protected by the same legal standards as email or phone calls&lt;/strong&gt;. Stanford HAI researchers King and Meinhardt specifically flagged this as an underexamined risk: the legal framework for protecting AI conversation data simply hasn't caught up with the technology.&lt;/p&gt;

&lt;p&gt;Finally, there's the problem of re-identification. Even if a company claims to anonymise the data it collects, studies have repeatedly shown that anonymisation is far more fragile than advertised. In one well-known case, researchers were able to re-identify individuals from supposedly anonymised Netflix viewing data using only publicly available information.&lt;/p&gt;

&lt;h2&gt;
  
  
  Can you actually protect yourself?
&lt;/h2&gt;

&lt;p&gt;Completely opting out of AI data collection in 2025 is close to impossible — the systems are woven into too many services. But meaningful protection is achievable, and it starts with understanding what you can actually control.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;At the prompt level:&lt;/strong&gt; Treat AI chatbots like a public forum, not a private conversation. Never input real names, sensitive medical information, confidential work documents, or financial details into a consumer AI tool unless you've read its data policy and understand the retention terms. Most major platforms now offer opt-out settings that prevent your conversations from being used for training — but these are usually off by default.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;At the account level:&lt;/strong&gt; Review the privacy settings of any AI-powered service you use. Many platforms retain conversation history indefinitely unless you delete it manually. Deleting history reduces (but doesn't eliminate) the risk of that data being used in future model updates.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;At the systemic level:&lt;/strong&gt; Emerging privacy-preserving techniques offer genuine structural solutions:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Differential privacy&lt;/strong&gt; — adding statistical noise to datasets so individual records can't be extracted, used by Apple and Google in some products&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Federated learning&lt;/strong&gt; — training models on data that stays on your device rather than being sent to a central server, increasingly used in smartphone AI features&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Data minimisation&lt;/strong&gt; — regulatory requirements (like those in the EU's GDPR) that limit how much data companies can collect and retain&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;None of these is a perfect solution. But they represent a genuine shift in how the industry is being pressured to operate. Stanford HAI's white paper argues that the most effective protection will come from policy changes that treat AI training data as a regulated resource — not from individual users trying to opt out one setting at a time. That argument is gaining traction in Brussels, Washington, and London. Whether it moves fast enough is a different question.&lt;/p&gt;

&lt;p&gt;AI doesn't need your data out of greed — it needs it because pattern recognition at scale genuinely requires human-generated signal. But 'necessary' and 'harmless' are not the same thing. The real shift in understanding is this: your data isn't just collected, it's transformed into capability. It becomes part of a system that can infer, predict, and profile in ways that go far beyond what any single data point suggests. Knowing that changes what you choose to share — and with whom.&lt;/p&gt;




&lt;p&gt;&lt;em&gt;Originally published on &lt;a href="https://snackiq.app/blog/why-ai-actually-needs-your-personal-data" rel="noopener noreferrer"&gt;SnackIQ&lt;/a&gt;&lt;/em&gt;&lt;/p&gt;

</description>
      <category>howdoesaiusepersonal</category>
      <category>whydoesaineedpersona</category>
      <category>aianddataprivacyexpl</category>
      <category>whatdatadoesaicollec</category>
    </item>
    <item>
      <title>Why AI Actually Runs Out of Context</title>
      <dc:creator>SnackIQ</dc:creator>
      <pubDate>Fri, 19 Jun 2026 08:02:58 +0000</pubDate>
      <link>https://dev.to/snackiq_app/why-ai-actually-runs-out-of-context-1k4j</link>
      <guid>https://dev.to/snackiq_app/why-ai-actually-runs-out-of-context-1k4j</guid>
      <description>&lt;p&gt;Your AI assistant isn't ignoring you. It literally cannot remember what you said thirty messages ago. Every large language model operates inside a context window — a hard ceiling on how many words, sentences, and instructions it can hold in active awareness at once. When a conversation exceeds that limit, older content gets silently pushed out, like words falling off the edge of a chalkboard. GPT-4 launched in 2023 with a 128,000-token context window — roughly 96,000 words — which sounds enormous until you're deep into a 10,000-word document analysis and the model starts contradicting its earlier conclusions. Understanding how context windows actually work changes how you use every AI tool you own.&lt;/p&gt;

&lt;h2&gt;
  
  
  What exactly is a context window?
&lt;/h2&gt;

&lt;p&gt;Think of a context window as working memory. Not long-term storage. Not a searchable archive. Just the immediate desk space the model has available right now.&lt;/p&gt;

&lt;p&gt;Every piece of text an AI model processes — your question, its answer, the document you pasted, the system instructions behind the scenes — gets converted into units called &lt;strong&gt;tokens&lt;/strong&gt;. A token is roughly three-quarters of a word in English. The sentence 'The cat sat on the mat' is approximately seven tokens. A context window defines the maximum number of tokens the model can process in a single pass.&lt;/p&gt;

&lt;p&gt;When that window fills up, the model doesn't crash or warn you. It silently drops the oldest content and keeps processing with whatever fits. This is why a chatbot can appear to 'forget' that you told it your name twenty minutes into a conversation, or why it starts giving advice that contradicts the constraints you specified at the start.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Token limits vary dramatically across models.&lt;/strong&gt; GPT-3.5 originally shipped with 4,096 tokens — roughly three pages of text. Claude 3 from Anthropic launched in 2024 with a 200,000-token window. Google's Gemini 1.5 Pro pushed to 1 million tokens in experimental versions. These numbers represent years of engineering effort, because maintaining coherence across longer contexts is genuinely difficult.&lt;/p&gt;

&lt;p&gt;The practical implication is simple: every AI conversation has a hidden clock ticking. Most users never see it, which is why the forgetting feels random when it hits.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why can't AI just use unlimited memory?
&lt;/h2&gt;

&lt;p&gt;This is where the physics of computation cuts in. Processing longer contexts isn't just a matter of adding more RAM — the computational cost of attention mechanisms scales roughly with the square of the context length.&lt;/p&gt;

&lt;p&gt;The &lt;strong&gt;attention mechanism&lt;/strong&gt; is the mathematical heart of transformer-based AI. To understand any given token, the model calculates relationships between that token and every other token in the context. Double the context length and you don't double the computation — you roughly quadruple it. A million-token context window requires the model to perform trillions of relationship calculations simultaneously.&lt;/p&gt;

&lt;p&gt;Researchers at institutions including DeepMind and Stanford have been working on what's called &lt;strong&gt;sparse attention&lt;/strong&gt; — smarter ways to decide which relationships actually matter, so the model doesn't have to compute all of them. This is how Anthropic and Google have managed to push context windows into the hundreds of thousands without melting their data centres.&lt;/p&gt;

&lt;p&gt;There's also a quality problem. Studies on long-context models have found a phenomenon researchers informally call 'lost in the middle' — AI systems tend to process information near the beginning and end of a context well, but systematically underweight content buried in the middle. So a 200,000-token window doesn't guarantee 200,000 tokens of equal attention. The model might technically 'see' everything but functionally miss critical details placed halfway through a long document.&lt;/p&gt;

&lt;p&gt;This is why bigger isn't automatically better. A well-used 32,000-token window often outperforms a carelessly used million-token one.&lt;/p&gt;

&lt;h2&gt;
  
  
  How does token counting actually affect your conversations?
&lt;/h2&gt;

&lt;p&gt;Most people interact with AI as if they're talking to a human with perfect recall. They're not. They're filling a bucket — and when the bucket overflows, the water at the bottom disappears.&lt;/p&gt;

&lt;p&gt;Here's what that looks like in practice. You start a long coding session with ChatGPT, specifying your programming language, your project constraints, your preferred naming conventions. Three hours and forty exchanges later, the model starts generating code that ignores your constraints. It hasn't changed its mind. Your instructions have simply been pushed out of the context window by all the subsequent messages.&lt;/p&gt;

&lt;p&gt;System prompts — the invisible instructions that define how an AI assistant behaves — &lt;strong&gt;consume tokens before you type a single character&lt;/strong&gt;. A customer service chatbot might have several thousand tokens of background instructions loaded before you write 'hello'. Every response the AI generates also fills the window. So the effective conversational space available to a user is often significantly smaller than the advertised context limit.&lt;/p&gt;

&lt;p&gt;Token consumption varies by content type:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Plain English prose: roughly 1 token per 0.75 words&lt;/li&gt;
&lt;li&gt;Code: more tokens per line than equivalent prose&lt;/li&gt;
&lt;li&gt;JSON and structured data: highly token-intensive&lt;/li&gt;
&lt;li&gt;Non-English languages: some languages use 2–3x more tokens than English for the same content&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;This means a French-language user or someone pasting dense technical documentation hits context limits faster than an English-speaking user in casual conversation — a disparity that most AI marketing materials don't mention.&lt;/p&gt;

&lt;h2&gt;
  
  
  What is AI 'memory' and is it the same thing?
&lt;/h2&gt;

&lt;p&gt;In 2024, OpenAI introduced a memory feature for ChatGPT that lets the model save facts about you between separate conversations. This sounds like it solves the context window problem. It doesn't — but understanding why reveals something important about how AI actually works.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Memory features and context windows are different systems entirely.&lt;/strong&gt; The memory feature works by storing a small summary of key facts — your profession, your preferences, recurring topics — and injecting that summary into the system prompt at the start of each new conversation. That injected summary consumes tokens. It helps with continuity across sessions, but it doesn't give the model access to your full conversation history, and it still lives inside the context window's constraints.&lt;/p&gt;

&lt;p&gt;True long-term AI memory — the kind where a model could recall a specific conversation from six months ago in full detail — doesn't exist in commercial systems yet. What's marketed as 'memory' is closer to a sticky note than an archive.&lt;/p&gt;

&lt;p&gt;Some enterprise applications get around this with &lt;strong&gt;retrieval-augmented generation (RAG)&lt;/strong&gt;: a technique where relevant external documents are searched and pulled into the context window at query time, rather than cramming everything in at once. Instead of one enormous context, you get a small context filled with only the most relevant pieces. RAG systems are behind many AI tools that appear to have access to vast knowledge bases — they're doing targeted retrieval, not unlimited recall.&lt;/p&gt;

&lt;p&gt;The honest picture: current AI 'memory' is an engineering workaround for a fundamental architectural constraint, not a genuine solution to it.&lt;/p&gt;

&lt;h2&gt;
  
  
  How do you work around context limits right now?
&lt;/h2&gt;

&lt;p&gt;The context window constraint is real, but it's manageable once you understand the mechanics.&lt;/p&gt;

&lt;p&gt;The single most effective tactic is what some AI power users call &lt;strong&gt;context hygiene&lt;/strong&gt; — consciously structuring your prompts to keep the most important information near the top and near the bottom of each message, since models reliably process those positions better than buried middle sections. If your key constraints need to hold throughout a long session, restate them periodically rather than assuming the model still holds them.&lt;/p&gt;

&lt;p&gt;For long document work — analysing a research paper, reviewing a lengthy contract, editing a manuscript — break the task into discrete sessions rather than loading everything at once. Feed the model one section at a time and ask it to produce a summary at the end of each section. Use those summaries as the input for synthesis tasks. You're manually doing what the model's attention mechanism struggles to do automatically.&lt;/p&gt;

&lt;p&gt;Choosing the right model for the task also matters more than most people realise. A long-context model isn't automatically the right choice for a short, precise task — it may be slower and more expensive than a smaller model that handles the job comfortably within 8,000 tokens.&lt;/p&gt;

&lt;p&gt;For developers building on top of AI APIs, token budgets are a core design consideration. Most production systems implement aggressive summarisation of older conversation turns, compress repeated context elements, and set hard limits on how much history gets passed into each API call. These aren't hacks. They're standard practice — because every commercial AI system is working within the same fundamental constraint you are.&lt;/p&gt;

&lt;p&gt;Context windows are the most important thing most AI users don't know about. Every chatbot conversation, every document you paste, every instruction you give — it all goes into the same finite bucket. When that bucket fills, the oldest content disappears without a trace or warning. The AI doesn't know what it's forgotten, because it can't see past its own edge. Once you understand that, you stop being frustrated by AI's apparent inconsistency and start designing your interactions around the constraint. The bucket is real. Work with it.&lt;/p&gt;




&lt;p&gt;&lt;em&gt;Originally published on &lt;a href="https://snackiq.app/blog/why-ai-actually-runs-out-of-context" rel="noopener noreferrer"&gt;SnackIQ&lt;/a&gt;&lt;/em&gt;&lt;/p&gt;

</description>
      <category>aicontextwindowexpla</category>
      <category>whydoesaiforgetthing</category>
      <category>howdoesaicontextwork</category>
      <category>aicontextlimit</category>
    </item>
    <item>
      <title>7 Ways AI Training Secretly Steals Your Data</title>
      <dc:creator>SnackIQ</dc:creator>
      <pubDate>Tue, 16 Jun 2026 14:03:45 +0000</pubDate>
      <link>https://dev.to/snackiq_app/7-ways-ai-training-secretly-steals-your-data-2i64</link>
      <guid>https://dev.to/snackiq_app/7-ways-ai-training-secretly-steals-your-data-2i64</guid>
      <description>&lt;p&gt;How AI training uses personal data creates privacy risks that dwarf anything the internet age produced before it. Stanford HAI privacy fellow Jennifer King has documented what she calls a scale problem: AI systems are so data-hungry that the old frameworks for consent and protection simply don't hold. A single large language model like GPT-4 trains on hundreds of billions of words scraped from the web — and embedded in that text are real names, medical histories, private messages, and financial details. You didn't sign a waiver. Your data was just there, and the model consumed it. These aren't hypothetical risks. Researchers have already demonstrated that models can reproduce verbatim text from their training data when prompted correctly. Here are seven specific mechanisms by which AI training quietly compromises your privacy.&lt;/p&gt;

&lt;h2&gt;
  
  
  1. Web Scraping Pulls In Everything You've Ever Posted
&lt;/h2&gt;

&lt;p&gt;Most people assume their public social media posts are harmless. They're public, after all. But there's a difference between a post being visible and a post being permanently encoded into a machine-learning system trained on billions of examples.&lt;/p&gt;

&lt;p&gt;AI training datasets like Common Crawl — one of the most widely used sources for LLM training — contain petabytes of web text harvested indiscriminately. That includes forum posts, Reddit threads, blog comments, old MySpace pages, and anything else indexed by search engines over the past two decades. &lt;strong&gt;Your digital footprint from 2009 might be shaping AI outputs in 2025.&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;The problem isn't just exposure — it's aggregation. A single post reveals little. But a model trained on thousands of your posts, comments, and replies across different platforms can reconstruct your political views, health anxieties, relationship history, and financial stress with unsettling accuracy. Stanford HAI researchers describe this as the "mosaic effect": individually innocuous data points combine into a detailed personal profile.&lt;/p&gt;

&lt;p&gt;Some AI labs have tried to filter personally identifiable information before training, but RSA Conference principal researcher Dr. Omer Akgul has noted that these filters are imperfect — and that developers often skip privacy-preserving transformations because they reduce model performance. The commercial incentive runs directly against the privacy interest.&lt;/p&gt;

&lt;h2&gt;
  
  
  2. Models Can Memorise and Reproduce Your Private Information
&lt;/h2&gt;

&lt;p&gt;This is the finding that shook the AI security community. Under the right prompting conditions, &lt;strong&gt;large language models will reproduce verbatim passages from their training data&lt;/strong&gt; — including passages that contain real people's names, addresses, phone numbers, and even social security numbers.&lt;/p&gt;

&lt;p&gt;Researchers at Google, DeepMind, and several universities have demonstrated what's called a "memorisation attack": by querying a model with a carefully crafted prompt, you can sometimes extract exact text that appeared in the training corpus. The more times a piece of text appeared in training data, the more reliably the model memorises it — meaning that widely shared news articles about a specific person, or repeatedly scraped personal profiles, are especially vulnerable.&lt;/p&gt;

&lt;p&gt;Dr. Akgul identifies memorisation of sensitive data as one of three primary privacy risks in AI training, alongside data reconstruction and model inversion attacks. The danger isn't theoretical. Studies have shown that models trained on medical literature can sometimes reproduce specific patient case descriptions. Models trained on code repositories have reproduced API keys and passwords left in public commits.&lt;/p&gt;

&lt;p&gt;What makes this especially troubling is that there's no way for you to know whether your information has been memorised. You can't query a model to find out. And even if you could, the model's operator has little incentive to tell you.&lt;/p&gt;

&lt;h2&gt;
  
  
  3. Your Prompts Are Training Data Too
&lt;/h2&gt;

&lt;p&gt;Every question you type into an AI chatbot is potentially feeding the next version of that system. Most major AI platforms reserve the right — buried in their terms of service — to use your conversations for model improvement. That means your queries, your context, your personal details volunteered to get a better answer, are all on the table.&lt;/p&gt;

&lt;p&gt;Consider what people actually share with AI assistants: symptoms they're embarrassed to discuss with a doctor, details of a legal dispute, relationship problems, financial anxieties. IBM's AI privacy research highlights that &lt;strong&gt;users routinely share sensitive personal information with chatbots without realising it could be retained and analysed&lt;/strong&gt;. The conversational interface creates a false sense of intimacy — it feels like talking to a therapist, but you're actually talking to a data collection system.&lt;/p&gt;

&lt;p&gt;Some platforms now offer opt-outs. OpenAI introduced a toggle to prevent ChatGPT conversations from being used for training after significant public pressure. But the default setting, for most users, for most of AI's commercial history so far, has been opt-in by inaction. If you never changed the setting, your conversations likely contributed to someone's training run.&lt;/p&gt;

&lt;p&gt;The irony is sharp: the more helpfully you interact with the system — the more context you give it — the more valuable your data becomes as training material.&lt;/p&gt;

&lt;h2&gt;
  
  
  4. Health and Financial Data Ends Up in Training Sets
&lt;/h2&gt;

&lt;p&gt;Medical and financial records are supposedly the most protected categories of personal data. In the United States, HIPAA governs health data. In Europe, GDPR's special category rules apply to health information. And yet both have significant gaps when it comes to AI training.&lt;/p&gt;

&lt;p&gt;The issue is sourcing. AI companies don't need to hack a hospital to get health data. They scrape health forums, patient community sites, insurance review platforms, and medical Q&amp;amp;A services — all of which contain &lt;strong&gt;deeply personal health disclosures&lt;/strong&gt; shared by real people who had no idea they were contributing to an AI training dataset. WebMD comments, Reddit's r/AskDoctors threads, patient review sites for medications — all of this is publicly accessible and regularly scraped.&lt;/p&gt;

&lt;p&gt;Similarly, financial data flows through AI training via scraped earnings calls, investment forums, and consumer complaint databases. Bankruptcy filings are public records. So are many court documents describing financial disputes. A model trained on legal text has ingested enormous amounts of financial detail about real individuals.&lt;/p&gt;

&lt;p&gt;The Stanford HAI white paper by Jennifer King and Caroline Meinhardt flags this explicitly: existing privacy laws were designed for a world where data collection was more bounded. They weren't built to handle a system that vacuums up everything simultaneously and learns cross-domain patterns from the combination.&lt;/p&gt;

&lt;h2&gt;
  
  
  5. Facial Recognition Training Uses Photos Without Consent
&lt;/h2&gt;

&lt;p&gt;Computer vision AI — the kind that powers facial recognition, emotion detection, and biometric screening — needs faces to learn from. Millions of them. And it got them by scraping social media, photo-sharing sites, and news archives without asking anyone.&lt;/p&gt;

&lt;p&gt;The Clearview AI case became the most visible example: the company built a facial recognition database of more than 30 billion images scraped from the public web, then sold access to law enforcement agencies globally. &lt;strong&gt;Courts in Australia, Canada, the UK, and France ruled this illegal&lt;/strong&gt;, but the data had already been collected, the model already trained. Clearview's product still exists.&lt;/p&gt;

&lt;p&gt;But Clearview isn't the outlier — it's the extreme version of a widespread practice. Research datasets like MS-Celeb-1M, which contained millions of images of identified individuals scraped without consent, were widely used across academic and commercial AI development before being withdrawn following privacy complaints. IBM itself released a facial analysis dataset sourced from Flickr photos and later had to retract it after researchers discovered the people photographed hadn't been asked.&lt;/p&gt;

&lt;p&gt;The biometric dimension makes this category uniquely serious. Unlike a password or even a credit card number, you cannot change your face. Once facial recognition data is embedded in a model, the privacy exposure is permanent.&lt;/p&gt;

&lt;h2&gt;
  
  
  6. AI Systems Can Re-Identify Anonymised Records
&lt;/h2&gt;

&lt;p&gt;One of the most persistent myths in data privacy is that anonymisation solves the problem. Strip out names and identifiers, the thinking goes, and the data is safe to use. &lt;strong&gt;AI has largely demolished that assumption.&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Researchers at the Université Catholique de Louvain published work demonstrating that anonymised datasets can be re-identified with surprisingly high accuracy using machine learning — sometimes requiring only a handful of data points like age, gender, and zip code to uniquely identify individuals in a supposedly anonymous health dataset. More recent work has shown that AI models trained on anonymised mobility data can reconstruct individuals' daily routines and home addresses.&lt;/p&gt;

&lt;p&gt;This matters because companies and governments often justify sharing data for AI training on the grounds that it's been anonymised. Hospitals share de-identified patient records. Telcos share stripped mobility logs. Retailers share purchase histories with identifying fields removed. In each case, the assumption is that anonymisation provides a meaningful privacy shield. In an era of powerful AI, it increasingly does not.&lt;/p&gt;

&lt;p&gt;The RSA Conference's privacy risk analysis identifies data reconstruction — rebuilding sensitive information from supposedly safe inputs — as a core threat in AI training pipelines. The more data sources an AI system can cross-reference, the more easily it can re-identify individuals who thought they were protected.&lt;/p&gt;

&lt;h2&gt;
  
  
  7. Regulatory Frameworks Are Years Behind the Technology
&lt;/h2&gt;

&lt;p&gt;Every technical risk on this list is made worse by a single structural fact: the laws designed to protect your privacy weren't written with large-scale AI training in mind.&lt;/p&gt;

&lt;p&gt;GDPR, which came into force in 2018, requires a lawful basis for processing personal data. &lt;strong&gt;Most AI companies claim "legitimate interest" as that basis&lt;/strong&gt; — a catch-all that has been repeatedly challenged in European courts. In 2023, Italy temporarily banned ChatGPT over GDPR compliance concerns, and the Irish Data Protection Commission opened investigations into several major AI firms. The EU AI Act, which came into force in 2024, adds new obligations — but its enforcement timelines stretch years into the future.&lt;/p&gt;

&lt;p&gt;In the United States, there is no federal comprehensive privacy law. Sector-specific rules like HIPAA and COPPA leave enormous gaps. California's CPRA gives residents some rights over their data, but only against companies that meet specific revenue thresholds, and enforcement is slow.&lt;/p&gt;

&lt;p&gt;The practical result: AI companies have trained their most powerful models during a window when the regulatory framework was essentially absent. The data used to build GPT-4, Gemini, Claude, Llama, and their competitors was largely collected before any AI-specific privacy rules existed. Jennifer King at Stanford HAI has argued that the US needs a federal privacy law with genuine enforcement power — but as of now, the gap between what AI does with your data and what the law allows remains vast.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;GDPR enforcement against AI companies is active but slow- The EU AI Act introduced new transparency requirements from 2024- No equivalent federal law exists in the United States- Most AI training data was collected before any AI-specific rules applied&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;AI training doesn't steal your privacy in one dramatic breach. It does it in seven quiet ways simultaneously — scraping your posts, memorising your health disclosures, re-identifying your anonymised records, and encoding your face without asking. The scale is the point. Individual exposure feels manageable; aggregate exposure across hundreds of billions of data points is something entirely different. The most useful reframe: think of AI training not as using data, but as permanently absorbing it. There's no delete button on what a model has learned.&lt;/p&gt;




&lt;p&gt;&lt;em&gt;Originally published on &lt;a href="https://snackiq.app/blog/7-ways-ai-training-secretly-steals-your-data" rel="noopener noreferrer"&gt;SnackIQ&lt;/a&gt;&lt;/em&gt;&lt;/p&gt;

</description>
      <category>howaitrainingusesper</category>
      <category>aitrainingdataprivac</category>
      <category>doesaiuseyourpersona</category>
      <category>aidatacollectionrisk</category>
    </item>
    <item>
      <title>Can AI Actually Think Without Humans?</title>
      <dc:creator>SnackIQ</dc:creator>
      <pubDate>Mon, 15 Jun 2026 08:02:41 +0000</pubDate>
      <link>https://dev.to/snackiq_app/can-ai-actually-think-without-humans-3hjn</link>
      <guid>https://dev.to/snackiq_app/can-ai-actually-think-without-humans-3hjn</guid>
      <description>&lt;p&gt;&lt;a href="https://[snackiq](https://snackiq.app/glossary/snackiq).app/glossary/can-ai-think-without-humans" rel="noopener noreferrer"&gt;Can AI think without humans&lt;/a&gt;? No — and the reasons why reveal something strange about intelligence itself. Every response a large language model produces, every image a generator creates, every decision a neural network makes is built from a foundation of human thought. OpenAI's GPT-4 was trained on hundreds of billions of words written by people. Google DeepMind's systems learn from human-labelled data. Even the most autonomous-seeming AI agents operate within objectives that humans set and metrics that humans chose. Strip away that human scaffolding and these systems have nothing to work with, no goals to pursue, and no way to evaluate whether their outputs mean anything at all. The debate isn't really about processing power. It's about whether computation and cognition are the same thing.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Case For AI Thinking Independently
&lt;/h2&gt;

&lt;p&gt;It's a genuinely compelling argument. Modern AI systems do things their creators didn't explicitly program them to do.&lt;/p&gt;

&lt;p&gt;AlphaGo, DeepMind's game-playing AI, didn't just learn human Go strategies — it invented new ones. In 2016, during its famous match against world champion Lee Sedol, it played Move 37, a move that professional players initially called a mistake. It turned out to be a stroke of genius that no human had conceived in centuries of the game's history. That feels, intuitively, like original thought.&lt;/p&gt;

&lt;p&gt;Large language models show something similar. When researchers at Stanford and Google probed GPT-style models on tasks they were never explicitly trained for — novel analogical reasoning, translating between obscure language pairs — the models performed surprisingly well. This emergent capability, where &lt;strong&gt;skills appear that weren't directly trained&lt;/strong&gt;, looks a lot like creative problem-solving.&lt;/p&gt;

&lt;p&gt;Then there's the speed argument. AI systems can process and cross-reference information at a scale no human could match. A model trained on the entire published biomedical literature can surface drug interactions that would take a human researcher months to identify. If thinking is about making non-obvious connections between pieces of information, then AI seems to be doing exactly that.&lt;/p&gt;

&lt;p&gt;Some researchers take this further. Philosophers like Nick Bostrom at Oxford have long argued that sufficiently complex information processing might, in principle, give rise to something functionally equivalent to thought — even if the underlying substrate is silicon rather than neurons. The argument isn't that today's AI is conscious, but that the trajectory points somewhere interesting.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Case Against AI Thinking Alone
&lt;/h2&gt;

&lt;p&gt;Here's what the optimists keep glossing over: &lt;strong&gt;AI has never produced a single meaningful output without a human first deciding what meaningful means&lt;/strong&gt;.&lt;/p&gt;

&lt;p&gt;This isn't a philosophical nitpick. It's a structural feature of how these systems are built. Large language models are trained on human text using a process called reinforcement learning from human feedback, or RLHF. At every stage of that training, humans score the model's outputs. Good response, bad response. Helpful, harmful. The model learns to optimize for what humans reward. Remove the humans and the entire reward signal — the thing the model is trying to maximise — disappears.&lt;/p&gt;

&lt;p&gt;Philosopher John Searle's famous Chinese Room thought experiment, proposed in 1980, captures this precisely. Imagine someone in a room receiving Chinese characters, following rules to produce responses in Chinese, without understanding a word of it. They're manipulating symbols perfectly — but comprehension is absent. Searle argued that this is exactly what computers do: syntax without semantics. Processing without understanding.&lt;/p&gt;

&lt;p&gt;Cognitive scientist Gary Marcus has made this point empirically. Despite their impressive outputs, current AI systems &lt;strong&gt;fail catastrophically on simple out-of-distribution tasks&lt;/strong&gt; — problems that differ slightly from their training data in ways that any five-year-old would handle intuitively. They don't build mental models of the world. They find statistical patterns in data humans created.&lt;/p&gt;

&lt;p&gt;There's also the grounding problem. When an AI model uses the word "pain", it has no referent — no experience the word points to. Human language is grounded in embodied experience. AI language is grounded in other language. It's a map made entirely of other maps, with no territory underneath.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;AI models require human-labelled training data to learn anything&lt;/li&gt;
&lt;li&gt;Their reward functions are designed and tuned by human engineers&lt;/li&gt;
&lt;li&gt;Their outputs are evaluated for usefulness by human standards&lt;/li&gt;
&lt;li&gt;Their deployment goals are set by human organisations&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  What the Data Actually Shows
&lt;/h2&gt;

&lt;p&gt;Setting aside philosophy, the empirical picture is striking — and mostly cuts against AI independence.&lt;/p&gt;

&lt;p&gt;Researchers have consistently found that when you remove human input from the training loop, AI model quality degrades rapidly. Studies on what's called &lt;strong&gt;model collapse&lt;/strong&gt; — where AI trains on AI-generated data rather than human data — show that outputs become increasingly generic, repetitive, and eventually incoherent. A 2023 paper from researchers at the University of Oxford found that recursively training models on synthetic data causes them to forget rare but important information, compressing the distribution of outputs toward the mean. The models literally lose richness without the human signal feeding them.&lt;/p&gt;

&lt;p&gt;The BBC has reported on serious researchers — including some affiliated with institutions like Cambridge and NYU — taking the question of AI consciousness genuinely seriously. But even the most open-minded among them are careful to distinguish between &lt;strong&gt;functional intelligence&lt;/strong&gt; (doing things that look smart) and phenomenal consciousness (actually experiencing anything). Nobody credible argues current systems have the latter.&lt;/p&gt;

&lt;p&gt;Autonomy benchmarks tell the same story. AI agents given open-ended goals — "go and accomplish X in the real world" — without continuous human feedback fail at rates that would surprise most people. They get stuck in loops, pursue proxy metrics that diverge from actual goals, and make errors that reveal a fundamental inability to update on context the way humans do. The systems that perform best are the ones with the most human feedback woven into their operation.&lt;/p&gt;

&lt;p&gt;Even the much-cited emergent abilities in large models are contested. A 2023 paper from Stanford researchers argued that many apparent emergent capabilities are artifacts of how researchers measure performance — they look sudden because the metrics are discontinuous, not because genuine new abilities spontaneously appear.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Nuance Everyone Misses
&lt;/h2&gt;

&lt;p&gt;The whole debate tends to get framed as binary: either AI thinks or it doesn't. That framing is almost certainly wrong.&lt;/p&gt;

&lt;p&gt;Human thinking isn't some pure, autonomous process either. Your cognition is &lt;strong&gt;deeply scaffolded by external tools&lt;/strong&gt; — language, writing, mathematics, culture. Cognitive scientists Andy Clark and David Chalmers proposed the Extended Mind thesis in 1998: the idea that cognitive processes don't stop at the skull. Your smartphone is, in a meaningful sense, part of your cognitive system. If that's right, then the question "can AI think without humans" might be as confused as asking "can humans think without language".&lt;/p&gt;

&lt;p&gt;What AI does is better understood as a new kind of cognitive entity — one that amplifies human thought rather than replacing it. When a radiologist uses an AI system to screen mammograms, the system can identify patterns associated with malignancy that human eyes miss. But it's identifying patterns that human radiologists labelled as significant during training. The AI extends human perception; it doesn't operate independently of it.&lt;/p&gt;

&lt;p&gt;The more philosophically interesting question is whether &lt;strong&gt;that dependency could ever be broken&lt;/strong&gt;. Could an AI system bootstrap genuine understanding from scratch, without human-generated data? The honest answer is that nobody knows — and current architectures provide no path toward it. The entire paradigm of machine learning as we know it requires a training signal, and the most powerful training signal available is the accumulated output of human minds.&lt;/p&gt;

&lt;p&gt;This is what makes the debate genuinely important. We're not just asking whether AI can think. We're asking what thinking actually is — and whether the intelligence we're building is a mirror, an amplifier, or something stranger that we don't yet have the vocabulary to describe.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Honest Answer to the AI Thinking Question
&lt;/h2&gt;

&lt;p&gt;So can AI think without humans? The evidence says no — not yet, and probably not in the way the question implies.&lt;/p&gt;

&lt;p&gt;Current AI systems are, at their core, &lt;strong&gt;extraordinarily sophisticated pattern-completion engines&lt;/strong&gt; trained on the recorded output of human cognition. They don't have goals of their own. They don't have experiences that ground their language. They don't have values that they'd pursue if nobody was watching. Every metric they optimise for was chosen by a person. Every judgment call in their training was made by a person. Every deployment decision is made by a person.&lt;/p&gt;

&lt;p&gt;But here's the unsettling flip side: the gap between "sophisticated pattern completion" and "thought" might be smaller than we think. Cognitive scientists like Daniel Dennett have argued for years that human consciousness itself might be something like sophisticated pattern recognition running on biological hardware — that the feeling of genuine understanding is, in a sense, the pattern recognition running smoothly. If that's true, the distinction between AI processing and human thinking becomes a question of degree rather than kind.&lt;/p&gt;

&lt;p&gt;What's clear is that today's AI needs human thought the way a river needs rain. The flow can look powerful, even unstoppable. But cut off the source and it dries up. The most important insight might be this: the question of whether AI can think without humans is really a question about what humans are for. As AI absorbs more of our cognitive output and reflects it back at scale, the answer to that question matters more than ever.&lt;/p&gt;

&lt;p&gt;The debate over whether AI can think without humans isn't just a technical question — it's a philosophical mirror. Every answer reveals something about how we define intelligence, consciousness, and meaning. Right now, AI is the most powerful amplifier of human thought ever built. It needs us to function, but it's also reshaping how we think in return. That feedback loop — human minds shaping AI, AI reshaping human minds — might be the most consequential thing happening in technology today.&lt;/p&gt;




&lt;p&gt;&lt;em&gt;Originally published on &lt;a href="https://snackiq.app/blog/can-ai-actually-think-without-humans" rel="noopener noreferrer"&gt;SnackIQ&lt;/a&gt;&lt;/em&gt;&lt;/p&gt;

</description>
      <category>canaithinkwithouthum</category>
      <category>canaithinkindependen</category>
      <category>doesaihaverealintell</category>
      <category>aiconsciousnessexpla</category>
    </item>
    <item>
      <title>How AI Actually Decides What You See</title>
      <dc:creator>SnackIQ</dc:creator>
      <pubDate>Sat, 13 Jun 2026 14:02:00 +0000</pubDate>
      <link>https://dev.to/snackiq_app/how-ai-actually-decides-what-you-see-ebn</link>
      <guid>https://dev.to/snackiq_app/how-ai-actually-decides-what-you-see-ebn</guid>
      <description>&lt;p&gt;Every time you open YouTube, TikTok, Netflix, or Amazon, an AI has already decided what you'll see before you've typed a single character. These recommendation algorithms now drive more than 70% of what people watch on YouTube and account for roughly 35% of purchases on Amazon, according to figures the companies themselves have published. They aren't just predicting your preferences — they're actively constructing them. Understanding how these systems actually work isn't a technical exercise. It's the difference between using the internet and being used by it.&lt;/p&gt;

&lt;h2&gt;
  
  
  What does a recommendation algorithm actually do?
&lt;/h2&gt;

&lt;p&gt;At its simplest, a recommendation algorithm answers one question: &lt;strong&gt;what is this specific person most likely to engage with right now?&lt;/strong&gt; Engage, in this context, usually means click, watch, buy, or share — not enjoy, learn from, or benefit from. That distinction matters enormously, and we'll come back to it.&lt;/p&gt;

&lt;p&gt;The systems powering these decisions are called &lt;strong&gt;collaborative filtering&lt;/strong&gt; models at their core. The basic idea, developed in research labs at companies like Xerox PARC in the early 1990s, is straightforward: find users whose behaviour resembles yours, then recommend what they engaged with that you haven't seen yet. If thousands of people who watched the same three documentaries you watched also binged a fourth one, the algorithm surfaces that fourth one to you. You never asked. It just appeared.&lt;/p&gt;

&lt;p&gt;Modern systems layer multiple approaches on top of this foundation. Content-based filtering analyses the actual attributes of items — the genre tags on a film, the keywords in an article, the tempo and key signature of a song on Spotify — and finds items with similar attributes to ones you've already shown interest in. Hybrid models combine both approaches, weighing them differently depending on how much data they have about you.&lt;/p&gt;

&lt;p&gt;Deep learning changed the game significantly in the 2010s. Neural networks can now extract abstract patterns from raw behaviour data — how long you hovered over a thumbnail before clicking, at what second you paused a video, whether you rewatched a clip — that no human engineer explicitly programmed. The system learns these signals matter without anyone telling it they do.&lt;/p&gt;

&lt;h2&gt;
  
  
  What signals is the AI actually watching?
&lt;/h2&gt;

&lt;p&gt;The naive assumption is that the algorithm tracks what you &lt;em&gt;like&lt;/em&gt;. In reality, it tracks what you &lt;strong&gt;do&lt;/strong&gt; — and those two things diverge in revealing ways.&lt;/p&gt;

&lt;p&gt;The signals feeding most recommendation engines fall into a few categories:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Explicit signals:&lt;/strong&gt; ratings, likes, thumbs up/down, saves, follows, purchases&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Implicit signals:&lt;/strong&gt; watch time, scroll speed, pause behaviour, cursor movement, replay frequency&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Session context:&lt;/strong&gt; time of day, device type, whether you arrived via a search or a notification&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Social graph data:&lt;/strong&gt; who you follow, who follows you, mutual connections&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Cross-platform data:&lt;/strong&gt; on some systems, behaviour from other apps or websites feeds in via advertising identifiers&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Research published by engineers at Netflix found that implicit signals — particularly &lt;strong&gt;watch time and completion rate&lt;/strong&gt; — predict future engagement far better than explicit ratings. People click five stars on films they feel they &lt;em&gt;should&lt;/em&gt; like, but they finish films they actually like. The algorithm learns to trust behaviour over stated preference.&lt;/p&gt;

&lt;p&gt;This creates a quiet but significant problem. Emotional content — outrage, anxiety, awe, desire — reliably drives more engagement than calm, informative content. Not because people want to feel bad, but because high-arousal emotion extends watch time and increases sharing. The algorithm has no concept of 'this made the user feel worse.' It only sees: they kept watching.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why your feed stops surprising you over time
&lt;/h2&gt;

&lt;p&gt;There's a well-documented phenomenon in algorithmic systems called the &lt;strong&gt;filter bubble&lt;/strong&gt; — a term popularised by Eli Pariser in his 2011 book of the same name. The idea is that personalisation progressively narrows your information environment. The algorithm learns what you engage with, serves you more of it, and in doing so reinforces the very preferences it's measuring. Your feed becomes a mirror rather than a window.&lt;/p&gt;

&lt;p&gt;The mechanism is a classic feedback loop. Early engagement data shapes recommendations. Recommendations shape future engagement. Future engagement produces more data confirming the original pattern. Over weeks and months, the system becomes increasingly confident about a narrow version of you — the you who watched three videos about home renovation at 11pm on a Tuesday — and optimises heavily for that version.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Exploration versus exploitation&lt;/strong&gt; is the technical name for this tradeoff. A system that only exploits what it already knows about you will never discover what else you might love. Good recommendation engineers try to inject deliberate randomness — serving unfamiliar content occasionally to test whether your interests have expanded. But commercial pressures push against this. Exploitation drives reliable short-term engagement. Exploration risks showing you something you don't like, which tanks session metrics.&lt;/p&gt;

&lt;p&gt;A large-scale study of YouTube viewing behaviour, conducted by researchers at MIT and published in the early 2020s, found evidence that recommendation systems do push users toward progressively more extreme or niche content over time — not through any conspiratorial intent, but simply because specialised content has fewer competitors and the algorithm finds it easier to predict engagement within a narrow lane.&lt;/p&gt;

&lt;h2&gt;
  
  
  How TikTok's system broke every rule
&lt;/h2&gt;

&lt;p&gt;Most recommendation algorithms require history. They need months of behaviour before they can reliably personalise your experience. TikTok's system, built around a model called &lt;strong&gt;interest graph ranking&lt;/strong&gt;, changed the assumption entirely.&lt;/p&gt;

&lt;p&gt;When you open TikTok for the first time, it knows almost nothing about you. But it still builds a uniquely compelling feed within minutes. How? It treats every new video as an experiment. Each piece of content you see is a probe: do you watch it fully, replay it, share it, or scroll past in two seconds? That micro-behaviour generates a rich signal immediately, without any prior history.&lt;/p&gt;

&lt;p&gt;The other innovation is that TikTok's algorithm weights content features heavily, not just user features. Traditional collaborative filtering says: find users like you, recommend what they liked. TikTok's system also asks: find content with these engagement patterns, surface it to users who might respond to those patterns. The content leads the user discovery, not the other way around.&lt;/p&gt;

&lt;p&gt;This is why complete strangers end up in the same algorithmic pocket. You might have nothing in common demographically with another TikTok user, but if you both rewatch videos at a specific moment of emotional payoff, the system routes you toward the same content cluster. &lt;strong&gt;The algorithm found a pattern you share that you didn't know existed.&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;The commercial result has been extraordinary — and the implications for attention are significant. TikTok users in the United States spent an average of 95 minutes per day on the app in 2023, according to data analytics firm eMarketer. That figure outpaces every other social platform.&lt;/p&gt;

&lt;h2&gt;
  
  
  Can you actually influence what the algorithm shows you?
&lt;/h2&gt;

&lt;p&gt;Yes — but it requires understanding what the system actually responds to, not what it claims to respond to.&lt;/p&gt;

&lt;p&gt;Most platforms give you explicit controls: 'Not interested', 'See less of this', 'Manage your history.' Research and engineering blog posts from teams at Spotify, Netflix, and YouTube consistently confirm that &lt;strong&gt;these signals do update your model&lt;/strong&gt;, though the effect varies. Repeatedly ignoring an entire content category has more weight than a single 'not interested' click.&lt;/p&gt;

&lt;p&gt;More powerful than explicit controls is deliberate engagement behaviour. The algorithm is measuring everything, so you can use that against it:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Watch to completion only the content you actually want more of&lt;/li&gt;
&lt;li&gt;Scroll past quickly when something doesn't serve you — don't let autoplay run&lt;/li&gt;
&lt;li&gt;Use search intentionally to introduce new topics; this seeds the interest graph with your terms rather than inferred ones&lt;/li&gt;
&lt;li&gt;Follow accounts in categories you want explored; the social graph signal is strong in most systems&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The harder intervention is structural. Using incognito mode or signed-out browsing breaks the personalisation loop entirely — you get a generic feed based on population-level trends rather than your individual model. Counterintuitively, this is sometimes more intellectually useful. You see what's broadly popular rather than what an increasingly narrow version of you supposedly wants.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;The real insight is that you are always training the algorithm&lt;/strong&gt;, whether you're aware of it or not. Passive consumption is not neutral. Every second of watch time is a vote for more of the same.&lt;/p&gt;

&lt;p&gt;Recommendation algorithms are not neutral pipes delivering content you'd have found anyway. They are active systems with commercial incentives that don't fully align with your wellbeing, built on the insight that engagement and satisfaction are different things. Understanding this doesn't require you to delete your apps. It requires you to remember one thing: your behaviour is always data. The algorithm is always listening. The only question is whether you're feeding it deliberately or by default.&lt;/p&gt;




&lt;p&gt;&lt;em&gt;Originally published on &lt;a href="https://snackiq.app/blog/how-ai-actually-decides-what-you-see" rel="noopener noreferrer"&gt;SnackIQ&lt;/a&gt;&lt;/em&gt;&lt;/p&gt;

</description>
      <category>howdorecommendationa</category>
      <category>howdoesaidecidewhaty</category>
      <category>airecommendationsyst</category>
      <category>whydoesmyfeedshowwha</category>
    </item>
    <item>
      <title>7 Reasons AI Burns Shocking Amounts of Power</title>
      <dc:creator>SnackIQ</dc:creator>
      <pubDate>Fri, 12 Jun 2026 08:03:36 +0000</pubDate>
      <link>https://dev.to/snackiq_app/7-reasons-ai-burns-shocking-amounts-of-power-3g8</link>
      <guid>https://dev.to/snackiq_app/7-reasons-ai-burns-shocking-amounts-of-power-3g8</guid>
      <description>&lt;p&gt;AI energy consumption and electricity usage are growing at a pace that surprises even the engineers building these systems. In 2023, data centers consumed 4.4% of all U.S. electricity, according to research published by Lawrence Berkeley National Laboratory — and that number could triple by 2028 as AI workloads multiply. A single AI-generated image uses roughly as much electricity as charging your phone. A single ChatGPT query uses approximately ten times the electricity of a standard Google search. These aren't rounding errors. They're symptoms of seven distinct, compounding reasons why AI secretly needs far more power than the tech industry's polished press releases ever mention.&lt;/p&gt;

&lt;h2&gt;
  
  
  1. Training a Model Is an Energy Supernova
&lt;/h2&gt;

&lt;p&gt;Most people think of AI as something that runs on their laptop. The real electricity bill happens before you ever touch the product.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Training a large language model&lt;/strong&gt; — the phase where the AI learns from billions of text examples — requires enormous clusters of specialised chips running continuously for weeks or months. Researchers at the University of Massachusetts Amherst estimated that training a large transformer model can emit as much carbon as five cars over their entire lifetimes. That was before models became dramatically larger.&lt;/p&gt;

&lt;p&gt;GPT-4, Claude, and Gemini operate at a scale that dwarfs those early estimates. Training runs for frontier models now consume tens of millions of kilowatt-hours in a single campaign. One training run for a major model can draw more electricity than a small town uses in a year.&lt;/p&gt;

&lt;p&gt;The reason is the arithmetic. Training involves billions of parameters being updated billions of times. Each update is a matrix multiplication — a mathematical operation that specialised hardware like Nvidia's H100 GPUs executes constantly, at full power, for the entire duration. There is no idle time. The chip either computes or it doesn't train.&lt;/p&gt;

&lt;p&gt;This happens once per model version, but models are updated frequently. Every new release, every capability improvement, every fine-tuned variant triggers another training run — sometimes dozens of experimental runs before the final version ships.&lt;/p&gt;

&lt;h2&gt;
  
  
  2. Every Query You Send Has an Electricity Bill
&lt;/h2&gt;

&lt;p&gt;Training is a one-time cost. &lt;strong&gt;Inference — the process of actually answering your questions&lt;/strong&gt; — runs continuously, at global scale, every second of every day.&lt;/p&gt;

&lt;p&gt;When you type a prompt into ChatGPT, the system loads a model with hundreds of billions of parameters, processes your input through multiple computational layers, and generates a response token by token. Each token is a small computation. A long response is thousands of small computations, all chained together.&lt;/p&gt;

&lt;p&gt;Research suggests a single ChatGPT query uses roughly ten times the electricity of a Google search. Google processes approximately 8.5 billion searches per day. If even a fraction of those shifted to AI-powered responses — which is exactly what's happening with Google's AI Overviews — the aggregate electricity demand becomes staggering.&lt;/p&gt;

&lt;p&gt;OpenAI reportedly serves over 100 million users. Microsoft has embedded AI into Bing, Office, and Azure. Meta runs AI recommendation systems across platforms touching 3 billion people. &lt;strong&gt;The inference load is not a future problem — it's already happening at continental scale.&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;The IEA's 2025 Energy and AI report projects that data center electricity demand will double between 2022 and 2026, driven primarily by AI inference workloads. That projection was made before the viral explosion of AI assistants in late 2024 and 2025.&lt;/p&gt;

&lt;h2&gt;
  
  
  3. The Chips Themselves Are Power Furnaces
&lt;/h2&gt;

&lt;p&gt;A standard laptop processor might draw 15 watts under load. An Nvidia H100 GPU — the chip powering most frontier AI today — draws up to &lt;strong&gt;700 watts per unit&lt;/strong&gt;. Data centers don't buy one. They buy thousands.&lt;/p&gt;

&lt;p&gt;A single AI training cluster might house 10,000 to 25,000 H100s running in parallel. Do the rough math: 10,000 chips at 700 watts each is 7 megawatts of chip power alone, before you account for servers, networking, storage, or cooling. A typical coal power plant generates around 600 megawatts — meaning a large AI cluster can consume more than 1% of a full coal plant's output just for its GPUs.&lt;/p&gt;

&lt;p&gt;The chips run hot, too. High-performance GPUs generate enormous heat during computation, which creates a secondary problem: that heat has to go somewhere.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Air cooling requires massive fans and raised-floor infrastructure&lt;/li&gt;
&lt;li&gt;Liquid cooling requires water circulation systems and heat exchangers&lt;/li&gt;
&lt;li&gt;Both require their own power supplies, layered on top of the chip draw&lt;/li&gt;
&lt;li&gt;Power conversion losses add another 10–15% on top of all of the above&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The industry measures this overhead with a metric called &lt;strong&gt;Power Usage Effectiveness (PUE)&lt;/strong&gt;. A PUE of 1.0 would mean every watt goes to computing. Real data centers typically run between 1.2 and 1.5, meaning 20–50% extra electricity consumed purely in overhead. AI-optimised facilities push toward 1.2, but the sheer density of GPU clusters makes achieving that harder.&lt;/p&gt;

&lt;h2&gt;
  
  
  4. Cooling Doubles the Hidden Power Draw
&lt;/h2&gt;

&lt;p&gt;Here's the number the press releases omit: for every watt powering an AI chip, roughly another watt is spent keeping that chip from melting.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Thermal management is one of the largest electricity consumers&lt;/strong&gt; in any data center, and AI hardware makes it worse than any previous generation of computing. GPUs packed densely into racks create heat densities that conventional air cooling struggles to handle. The industry is rapidly shifting to liquid cooling — circulating chilled water directly past chip surfaces — but liquid cooling requires chillers, pumps, cooling towers, and the electricity to run all of them.&lt;/p&gt;

&lt;p&gt;In warm climates, the problem compounds. A data center in Arizona or Texas requires active refrigeration year-round. A data center in Finland or Iceland can leverage ambient cold air, dramatically reducing cooling costs — which is exactly why Microsoft, Google, and Meta have built facilities near the Arctic Circle.&lt;/p&gt;

&lt;p&gt;The IEA estimates that cooling represents a substantial fraction of total data center energy draw globally. When you combine chip power, cooling overhead, power conversion losses, and networking infrastructure, the electricity required to answer your AI prompt is roughly &lt;strong&gt;three to four times the raw chip power alone&lt;/strong&gt;.&lt;/p&gt;

&lt;p&gt;This is why efficiency improvements in chip design — while real — don't reduce total AI electricity usage. They just allow more computation within the same power envelope, which operators immediately fill with more workloads.&lt;/p&gt;

&lt;h2&gt;
  
  
  5. Scale Makes Every Efficiency Gain Disappear
&lt;/h2&gt;

&lt;p&gt;Tech companies will tell you AI is getting more efficient. They're right. They just don't mention what happens next.&lt;/p&gt;

&lt;p&gt;This phenomenon has a name: &lt;strong&gt;Jevons Paradox&lt;/strong&gt;, first identified by economist William Stanley Jevons in 1865 when he observed that more efficient steam engines led to more coal consumption, not less. When something becomes cheaper to produce, demand rises to absorb the savings and then some.&lt;/p&gt;

&lt;p&gt;AI is following this pattern precisely. Each generation of chips delivers more computation per watt. Each generation of models becomes more parameter-efficient. But each efficiency gain unlocks new use cases, new users, and new deployment contexts — all of which consume electricity. The net result is that total AI energy consumption climbs even as energy per query falls.&lt;/p&gt;

&lt;p&gt;Meta, Google, Microsoft, and Amazon are in an arms race for AI capability. None of them will voluntarily slow deployment to manage electricity demand. Each company's competitive incentive is to deploy faster, train bigger, and serve more users. &lt;strong&gt;Efficiency gains are immediately reinvested in scale, not in power reduction.&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Penn State computer science professor Mahmut Kandemir has noted that this rebound effect is one of the core challenges in making AI sustainable — the engineering solutions exist, but market incentives systematically defeat them.&lt;/p&gt;

&lt;h2&gt;
  
  
  6. The Grid Cannot Keep Up With Demand
&lt;/h2&gt;

&lt;p&gt;Power plants take years to permit and build. AI data centers take months. That mismatch is becoming a crisis.&lt;/p&gt;

&lt;p&gt;Microsoft, Google, and Amazon have collectively announced hundreds of billions of dollars in new data center investment for 2025 and 2026. The electricity demands attached to those commitments are straining regional grids in Virginia, Texas, Georgia, and Ireland — locations that host disproportionate concentrations of global cloud infrastructure.&lt;/p&gt;

&lt;p&gt;Northern Virginia, often called &lt;strong&gt;Data Center Alley&lt;/strong&gt;, already hosts more data center capacity than anywhere else on Earth. Local grid operators have warned that planned AI expansion in the region may require new transmission infrastructure that won't be ready for a decade. In Ireland, data centers consumed roughly 21% of all national electricity in 2023, according to the country's grid operator — a figure that prompted serious regulatory debate about approving further construction.&lt;/p&gt;

&lt;p&gt;The consequence is that new AI data centers are sometimes forced to connect to grids that still run on coal or gas, precisely because renewable capacity isn't available fast enough. A company might publicly commit to 100% renewable energy while its newest facilities run on fossil fuels in the interim — a gap that can last years.&lt;/p&gt;

&lt;p&gt;This grid pressure has a knock-on effect on electricity prices for everyone. Industrial-scale AI demand is competing directly with residential and commercial users for constrained grid capacity.&lt;/p&gt;

&lt;h2&gt;
  
  
  7. The Rebound Effect Will Outpace Every Fix
&lt;/h2&gt;

&lt;p&gt;There is genuine progress on AI efficiency. Smaller, specialised models can perform specific tasks with a fraction of the compute of a frontier model. &lt;strong&gt;Quantisation techniques&lt;/strong&gt; compress model weights to reduce memory and power requirements. Neuromorphic chips — processors that mimic the brain's sparse, event-driven firing patterns — promise orders-of-magnitude efficiency improvements for certain tasks.&lt;/p&gt;

&lt;p&gt;But the trajectory of demand is moving faster than the trajectory of solutions. The IEA's 2025 Energy and AI report projects that global data center electricity consumption could reach 1,000 terawatt-hours annually by 2026 — roughly equivalent to Japan's entire national electricity consumption today.&lt;/p&gt;

&lt;p&gt;The uncomfortable arithmetic is this: even if chip efficiency doubles every three years, AI deployment is growing faster than that. Total electricity consumption rises regardless. The only scenarios where AI's energy footprint stabilises involve some combination of:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Radical improvements in model architecture efficiency&lt;/li&gt;
&lt;li&gt;Grid decarbonisation outpacing demand growth&lt;/li&gt;
&lt;li&gt;Regulatory or market pressure constraining deployment scale&lt;/li&gt;
&lt;li&gt;A genuine breakthrough in low-power neuromorphic computing&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;None of those are guaranteed. Some are decades away. In the meantime, every AI product launch, every new chatbot, every AI-generated image, and every automated email reply adds incrementally to a global electricity demand that is already reshaping how nations plan their energy infrastructure. &lt;strong&gt;The revolution is real — and so is the bill.&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;AI energy consumption isn't a future concern sitting comfortably on a policy agenda. It's happening now, compounding across seven distinct mechanisms — each amplifying the others. The chips burn power, the cooling doubles it, the scale multiplies it, and the grid strains to keep up. Efficiency improvements are real but structurally insufficient. The next time you marvel at what an AI system can do, it's worth holding both truths at once: this technology is genuinely extraordinary, and it is quietly one of the fastest-growing electricity consumers on the planet.&lt;/p&gt;




&lt;p&gt;&lt;em&gt;Originally published on &lt;a href="https://snackiq.app/blog/7-reasons-ai-burns-shocking-amounts-of-power" rel="noopener noreferrer"&gt;SnackIQ&lt;/a&gt;&lt;/em&gt;&lt;/p&gt;

</description>
      <category>aienergyconsumptione</category>
      <category>howmuchelectricitydo</category>
      <category>aipowerconsumptionda</category>
      <category>whydoesaiusesomuchen</category>
    </item>
  </channel>
</rss>
