Global Memory Shortage Crisis: Market Analysis

(idc.com)

62 points | by naves 6 hours ago ago

55 comments

  • Youden 35 minutes ago ago

    "However, this is not just a cyclical shortage driven by a mismatch in supply and demand, but a potentially permanent, strategic reallocation of the world’s silicon wafer capacity. [...] This is a zero-sum game: every wafer allocated to an HBM stack for an Nvidia GPU is a wafer denied to the LPDDR5X module of a mid-range smartphone or the SSD of a consumer laptop."

    I wonder if this will result in writing more memory-efficient software? The trend for the last couple of decades has been that nearly all consumer software outside of gaming has moved to browsers or browser-based runtimes like Electron. There's been a vicious cycle of heavier software -> more RAM -> heavier software but if this RAM shortage is permanent, the cycle can't continue.

    Apple and Google seemed to be working on local AI models as well. Will they have to scale that back due to lack of RAM on the devices? Or perhaps they think users will pay the premium for more RAM if it means they get AI?

    Or is this all a temporary problem due to OpenAI's buying something like 40% of the wafers?

    • treebeard901 2 minutes ago ago

      Code the AI will produce will solve the memory usage problems which is itself a result of lazy or poor human coders.

    • zozbot234 29 minutes ago ago

      There's plenty of scope for local AI models to become more efficient, too. MoE doesn't need too much RAM: only the parameters for experts that are active at any given time truly need to be in memory, the rest can be in read-only storage and be fetched on demand. If you're doing CPU inference this can even be managed automatically by mmap, whereas loading params into VRAM must currently be managed as part of running an inference step. (This is where GPU drivers/shader languages/programming models could also see some improvement, TBH)

    • duped 9 minutes ago ago

      It's not a zero sum game because silicon wafers are not a finite resource. Industry can and will produce more.

    • antisthenes 14 minutes ago ago

      > There's been a vicious cycle of heavier software -> more RAM -> heavier software but if this RAM shortage is permanent, the cycle can't continue.

      What do you mean it can't continue? You'll just have to deal with worse performance is all.

      Revolutionary consumer-side performance gains like multi-core CPUs and switching to SSDs will be a thing of distant past. Enjoy your 2 second animations, peasant.

  • hinkley an hour ago ago

    One of the things I’ve been hoping for every time a new EC2 instance comes out is for them to unpin the memory:core ratio a bit. I don’t expect they have enough r# and c# users to completely balance things out so what they’re really doing is selling people more CPUs to get the memory they need.

    It would be nice if it were creeping up generation to generation. But if this keeps up I fear the opposite.

    • zozbot234 26 minutes ago ago

      The best way of "unpinning" those ratios for many ephemeral workloads is to use Lambda/FaaS, not EC2.

      • hinkley 16 minutes ago ago

        kv stores also exist because for many generations of tooling it was faster to manage read-mostly data off-heap instead of on, and that becomes more true the more processes you run doing jobs that touch the same data.

  • RyanShook 2 hours ago ago

    I see this as a competitive opportunity for Apple. If Apple smartphone specs improve while Androids stagnate it could create more iOS users.

    The promised AI metaverse is still a long way off and in the meantime people still want the best smartphone.

    • root_axis an hour ago ago

      > if Apple smartphone specs improve while Androids stagnate it could create more iOS user

      Nah. The marginal utility of more smartphone ram is near zero at this point. The vast majority of people wouldn't even notice if the memory in their phone tripled overnight.

    • kllrnohj an hour ago ago

      How is it an opportunity for Apple? They are a customer of Samsung and Micron RAM modules just like everyone else is. They aren't in any unique position other than their user base is already used to paying extreme markup for RAM. Now whether Apple just eats the cost in their profit margin or charges even more for RAM remains to be seen.

      • krackers 15 minutes ago ago

        Their supply chain prowess likely means they have already secured contracts for 2026 (and maybe even 2027), so they will not be affected by the price hike. But maybe they'll still use it as an opportunity to bump prices and rake in free profit, who knows.

    • memoriuaysj 2 hours ago ago

      I have no idea how much RAM my phone has.

      And if you think that somebody buys an iPhone because they compare the specs with Android :)))))

      • Maxion an hour ago ago

        Basically if I have to start comparing iPhone specs to Android phone specs I might aswell just buy an Android. The point of iOS is that you don't have to.

      • arcbyte an hour ago ago

        I agree with you and have agreed with you for a long time. However, I definitely see the writing on the wall. More than one person in my circle have traditionally been Android users and the lack of innovation from both Apple and Android have them comparing devices on specs MUCH more. I include myself in this list on my next upgrade. I'll be looking largely at specs on the next upgrad because honestly there's not much day to day difference in usage between apple and android anymore

      • oezi an hour ago ago

        The competitive advantage comes from Apple having the supply chain contracts in place to not be affected by the 2026 price hike as much. The Android phones will be more expensive and thus will capture less market share.

    • layer8 2 hours ago ago

      Most regular people don’t care about RAM specs. And lately it’s Apple that has been rather stagnating in terms of features.

      • rockskon an hour ago ago

        What, because they aren't shoving an LLM in every orifice of their product?

      • neutronicus an hour ago ago

        I would love stagnation, the keyboard has always been a dumpster fire but these days it is an actively regressing dumpster fire

  • kristianp 2 hours ago ago

    > potential contraction in the global smartphone market alongside an increase in average selling prices (ASP). In 2026, in our moderate downside scenario, we could see the market contract by 2.9%. In our pessimistic downside scenario, it could be as bad as 5.2%.

    > PC market contract by 4.9% compared with a 2.4% year-on-year decline in the November forecast. Under a more pessimistic scenario, the decline could deepen to 8.9%.

  • IAmGraydon an hour ago ago

    Article completely misses the true cause of the price increase - Sam Altman/OAI made a deal with Samsung and SK Hynix get 40% of their RAM wafer production for the 2026 period. This was economic warfare against OpenAI's competitors, and the competitors along with the data centers responded by buying up every bit of DDR5 in sight. This price increase was engineered.

    The deal was inked on October 1, 2025, and rumors of it started swirling in September. Take a look at the RAM price charts. Anyone who attributes this just to "AI growth" has no idea what they're talking about. AI has been growing rapidly for three years and yet this price increase just happened exactly when Altman signed this deal.

    https://pcpartpicker.com/trends/price/memory/

    It's also worth noting that IDC, who published this report, is wholly owned by Blackstone, who is also heavily invested in OpenAI. It would be prudent to be cautious about who you believe.

    • anon373839 36 minutes ago ago

      Right! Raw wafers, not even memory. I have seen no evidence that this move was anything but a means of taking product out of the global supply chain.

      • IAmGraydon 32 minutes ago ago

        That's correct and a good point I almost forgot about - they can't even utilize what they bought!

        • kubb 20 minutes ago ago

          It feels like abuse. They shouldn't be able to get away with such trickery.

        • ThrowawayR2 12 minutes ago ago

          You do know that they can hire semiconductor packaging companies to put together memory modules the same way they bought the DRAM wafers, right?

    • zozbot234 21 minutes ago ago

      Doesn't Apple routinely do the same thing? Reserve chip production for the leading-edge nodes, and sometimes enter into similar deals for other tech such as displays? I'm not seeing any evidence that this was intentional "warfare" on OpenAI's part: they're just making a high-stakes bet that they can ultimately find a better and higher-margin use for that raw DRAM than HNers' gaming battlestations, or whatever the next-best use was when they made that deal.

      • duped 5 minutes ago ago

        No, apple does not buy production capacity to prevent others from using it. They buy it to use it themselves.

        The wafers are not DRAM. This is more likely burning oil wells so your enemy can't use them.

    • aunty_helen an hour ago ago

      After the dns entry, the stockpile of ram may be the most valuable asset that company has.

  • transcriptase 2 hours ago ago

    All so people in developing countries can churn out boomer-baiting slop for social media engagement farming and ad views.

    • crazydoggers 2 hours ago ago

      What makes you think it’s limited to boomers.. know of just as many millennials that eat the stuff up too.

      • willis936 2 hours ago ago

        As a millenial all I see is my generation being repulsed by AI slop. Boomers and zoomers though have a large presence of consumption. It was easy to see this with your own family over the holidays.

        • tempest_ 2 hours ago ago

          They will tell you they are repulsed by it if asked but its a toss up if they can identify it. Look at any thread on Reddit/IG/Tiktok whatever and I personally would guess I could manage to identify AI output 20% of the time.

          Boomers might be out there consuming those AI youtube videos that are just tiktok voice over with a generated slide show but Millennials think since they can identify this as slop that they are not affected. That is incorrect, and just as bad.

        • Forgeties79 2 hours ago ago
        • kubb 2 hours ago ago

          We musn't be unkind to the boomers. When we're their age, the methods for assaulting our poor old brains will be ever so more sophisticated.

          • willis936 2 hours ago ago

            I'm not blaming them. It's really frustrating that old people are taken advantage of. We shouldn't need to be so cynical. This isn't the star trek future we were promised.

            Edit: It's similarly frustrating about the zoomers. Parents are derelict of duty by not defending their kids and preparing them for the world they are in.

            • rkomorn an hour ago ago

              > This isn't the star trek future we were promised.

              It is, though. We're just in the part leading up to WWIII.

              • natebc an hour ago ago

                Yeah, that bit of the Star Trek Universe is something not many folks know about.

                You want to be born into the utopia, not before.

            • kubb an hour ago ago

              Sci-fi will never materialize. But the ones passionate about it are so desperate for the faux future that they won't be able to tell when they're being duped.

              Just wait until the next great collapse, a disaster big enough to force change. Hopefully we'll have the right ideas lying around at the time to restructure our social communication system.

              Until then, it's slow decline. Embrace it.

              • pixl97 an hour ago ago

                Sci-fi has materialized, we're living in it now. The problem is it's the dystopia edition.

        • crazydoggers 2 hours ago ago

          I think your sample of Millenials is probably more well informed.

          • bongodongobob an hour ago ago

            Nah, it's fueled by huge misinformation campaigns. It's going to kill art, put us all out of the job, uses 1.5 million gallons per query, pollutes water, will kill the electric grid, etc. These seem to be the most popular uninformed lines of thinking.

            • ssl-3 an hour ago ago

              We have always been at war with Eastasia.

            • pixl97 an hour ago ago

              Ya we seem to live in the the place where the firehose of falsehood is filling the lake of bullshit asymmetry. The problem with this is uninformed lines of thinking eventually lead to policy.

            • Forgeties79 an hour ago ago

              I agree several of the commonly repeated critiques are really poor in quality and can be emotionally driven/simply parroted TikTok nonsense, but at the other end of the spectrum we have AI evangelists who get surprisingly aggressive if you say anything remotely negative about GenAI or suggest maybe we should be having a discussion about the ethical ramifications of these tools. Particularly how they are trained and deployed and who should be guiding that process.

              I find it very odd when people proudly proclaim they used, say, Grok to answer a question. Their identity is so tied up in it that if you start talking about the quality of the information they get incredibly defensive. In contrast: I have never felt protective of my Google search results, which is basically the same thing given how most people use these tools currently.

              It’s kind of wild how hostile some people get if you attempt to open the discussion up at all.

  • TrackerFF an hour ago ago

    Imagine a future where a resourceful computer will be unobtanium, because AI companies decided to outbid consumers. Your PC will be just powerful enough to work as a terminal, with all the heavy lifting done by cloud compute data centers.

    Every functionality be will subscription-based. You'll own nothing and you'll be happy.

    • antonkochubey 42 minutes ago ago

      “Heavy lifting” here being running 108 MB of JavaScript to render shopping cart of an online store, correct?

      Or consuming 2 GB of RAM to have Teams running in the background doing nothing?

      Yeah, if we got rid of that as a result of RAM shortages, that’d be great.

    • nialse an hour ago ago

      That is the logical conclusion. The era of personal computers is coming to an end. It had a good run though.

      • Forgeties79 36 minutes ago ago

        Luckily Beelinks are still cheap, work decently, and can run Linux/Windows, so if all someone needs is to browse the Internet and do basic stuff, honestly? They’re fine. We’ll see how long that lasts though.

    • pixl97 an hour ago ago

      I mean this is one of the risk factors in AI safety that's been communicated for a long time. It's not just computing, but potentially everything. Energy resources, land resources (like those used to grow food for us meat bags), transportation resources. Suddenly humans find themselves outbid by AI as AI has pushed us out of the economy.

      The economy says nothing about requiring humans to exist.

  • kelseyfrog 2 hours ago ago

    I welcome this. Anything that makes consumer electronics more expensive acts counter to the Baumol Effect.

    How scarce does memory have to get before it makes health care half as expensive?

    • Avicebron an hour ago ago

      Where do you think the IT costs for doctor's workstations are going to be redirected?

      • kelseyfrog an hour ago ago

        I always thought it was more about differences in productivity between sectors. If the Baumol effect made service sector wages increase, would wouldn't ineffencies do the inverse?

    • bongodongobob an hour ago ago

      It makes all electronics more expensive. This makes every service more expensive as well.