The past two years were dominated by “ChatGPT-for-X” pitches and billion-dollar application rounds. Yet, somewhere between rising GPU spot prices and shrinking retention curves, investors began to realise that the defensible margins in AI sit far below the prompt window. Evidence of the rotation is now unmistakable. Crunchbase reports that while global venture dollars to chip startups fell overall in 2024, U.S. investment in semiconductor upstarts more than doubled—from $1.3 billion to nearly $3 billion—helped by mega-rounds at Groq and Lightmatter. Seed deals for Gen AI apps, by contrast, declined for the third consecutive quarter. The market is voting with its chequebook: infrastructure, not interfaces, will mint the next 20× outcomes. Crunchbase reports U.S. investment in semiconductor upstarts more than doubled—from $1.3 billion to nearly $3 billion—helped by mega-rounds at Groq and Lightmatter The pressure cooker inside the data centre Every generative model upgrade increases capital intensity: Every generative model upgrade increases capital intensity: Capacity crunch. The H100 backlog remains months long; clouds still rent them at $7–9 per hour.
Cap-ex shock. Microsoft alone will spend more than $50 billion on AI infrastructure this fiscal year, a record for any software company.
Unit-economics squeeze. Gross margins for pure-play chatbots have compressed as usage-based cloud bills outpace revenue. Capacity crunch. The H100 backlog remains months long; clouds still rent them at $7–9 per hour. Capacity crunch. Cap-ex shock. Microsoft alone will spend more than $50 billion on AI infrastructure this fiscal year, a record for any software company. Cap-ex shock. $50 billion Unit-economics squeeze. Gross margins for pure-play chatbots have compressed as usage-based cloud bills outpace revenue. Unit-economics squeeze. Against that backdrop, companies that can add even single-digit percentage gains to throughput—or shave watts from dense clusters—command strategic premiums. The story of CoreWeave makes the point: the Nvidia-backed GPU cloud pivoted from Ethereum mining to AI, landed an $11.9 billion OpenAI contract, and still raised $1.5 billion in a Nasdaq debut valuing it at $23 billion, despite scaling back the offer size in a jittery market.​ CoreWeave $11.9 billion OpenAI contract $1.5 billion in a Nasdaq debut valuing it at $23 billion What’s hot beneath the hood Custom silicon acceleration. Chiplet-based inference engines (d-Matrix), RISC-V grids (Tenstorrent), and single-core latency machines (Groq) all target Nvidia’s 80% gross margin moat. Custom silicon acceleration. Chiplet-based inference engines (d-Matrix), RISC-V grids (Tenstorrent), and single-core latency machines (Groq) all target Nvidia’s 80% gross margin moat. Custom silicon acceleration. Photonic & optical interconnect. Copper traces stall near 100 Gb/s; photons march into the terabit era. When Lightmatter closed a $400 million Series D at a $4.4 billion valuation last October, the lead investor framed it as the “missing fabric” that lets hundreds of GPUs behave like one super-device.​ Photonic & optical interconnect. Copper traces stall near 100 Gb/s; photons march into the terabit era. When Lightmatter closed a $400 million Series D at a $4.4 billion valuation last October, the lead investor framed it as the “missing fabric” that lets hundreds of GPUs behave like one super-device.​ Photonic & optical interconnect. Lightmatter $400 million Series D at a $4.4 billion valuation Memory & data-movement fabric. Startups such as Astera Labs (PCIe/CXL) have already exited at scale—$713 million raised in a 2024 IPO that valued the firm at $5.5 billion—because high-bandwidth memory, not raw TFLOPS, is the bottleneck for trillion-parameter models. Memory & data-movement fabric. Startups such as Astera Labs (PCIe/CXL) have already exited at scale—$713 million raised in a 2024 IPO that valued the firm at $5.5 billion—because high-bandwidth memory, not raw TFLOPS, is the bottleneck for trillion-parameter models. Memory & data-movement fabric. $713 million raised in a 2024 IPO that valued the firm at $5.5 billion Why the rotation has legs Policy tailwinds. The U.S. CHIPS Act, the EU’s IPCEI programme, and similar schemes in Japan and India are subsidising domestic fabs and advanced-packaging lines. Policy tailwinds. The U.S. CHIPS Act, the EU’s IPCEI programme, and similar schemes in Japan and India are subsidising domestic fabs and advanced-packaging lines. Policy tailwinds. Carbon math. AI data-centres could absorb 1,000 TWh annually by 2030. Optical I/O and near-memory compute cut energy per bit by an order of magnitude. Carbon math. AI data-centres could absorb 1,000 TWh annually by 2030. Optical I/O and near-memory compute cut energy per bit by an order of magnitude. Carbon math. 1,000 TWh Sovereign AI trends. Open-weight LLMs demand on-prem or national clouds, fostering regional silicon ecosystems and lowering political risk for investors. Sovereign AI trends. Open-weight LLMs demand on-prem or national clouds, fostering regional silicon ecosystems and lowering political risk for investors. Sovereign AI trends. Risks that still matter Overcapacity cycles. If TSMC, Intel Foundry Services and Samsung all bring new nodes online into a macro slowdown, pricing power vanishes. Overcapacity cycles. If TSMC, Intel Foundry Services and Samsung all bring new nodes online into a macro slowdown, pricing power vanishes. Overcapacity cycles. Algorithmic leaps. Sparse or linear-time architectures (e.g., Mamba) could dramatically reduce hardware needs. Algorithmic leaps. Sparse or linear-time architectures (e.g., Mamba) could dramatically reduce hardware needs. Algorithmic leaps. Geopolitics. A sudden thaw in U.S.–China export controls would flood the market with cheaper accelerators and erode start-up ASPs. Geopolitics. A sudden thaw in U.S.–China export controls would flood the market with cheaper accelerators and erode start-up ASPs. Geopolitics. Mitigation strategy: Back teams whose software ecosystems (kernels, SDKs, PyTorch plugs) create a layer of lock-in that survives node changes, exactly how Nvidia used CUDA to future-proof its GPU franchise. How to invest from here Optical IP now, before hyperscalers write the cheques. Valuations below $50 million for wafer-level photonics still exist—but not for long.


Packaging plays when grants hit. Advanced interposers and glass substrates will see an instant step-up when CHIPS Act awards are announced.


GPU cloud consolidators at $100 million+ ARR. Once interest-rate cuts arrive, these capital-heavy businesses become IPO candidates again.


Late-stage silicon seconds. By 2027, early investors in unicorn fabs will seek liquidity; secondary positions with visibility on revenue ramps can still clear 3–5×. Optical IP now, before hyperscalers write the cheques. Valuations below $50 million for wafer-level photonics still exist—but not for long. Optical IP now, before hyperscalers write the cheques. Valuations below $50 million for wafer-level photonics still exist—but not for long. Optical IP now, before hyperscalers write the cheques. Packaging plays when grants hit. Advanced interposers and glass substrates will see an instant step-up when CHIPS Act awards are announced. Packaging plays when grants hit. Advanced interposers and glass substrates will see an instant step-up when CHIPS Act awards are announced. Packaging plays when grants hit. GPU cloud consolidators at $100 million+ ARR. Once interest-rate cuts arrive, these capital-heavy businesses become IPO candidates again. GPU cloud consolidators at $100 million+ ARR. Once interest-rate cuts arrive, these capital-heavy businesses become IPO candidates again. GPU cloud consolidators at $100 million+ ARR. Late-stage silicon seconds. By 2027, early investors in unicorn fabs will seek liquidity; secondary positions with visibility on revenue ramps can still clear 3–5×. Late-stage silicon seconds. By 2027, early investors in unicorn fabs will seek liquidity; secondary positions with visibility on revenue ramps can still clear 3–5×. Late-stage silicon seconds. The bottom line Generative AI apps captured imaginations; infrastructure will capture the lasting cash flows. History, from railroads to fibre optics, shows that outsized returns accrue to those who solve throughput and logistics. In the AI gold rush, that means wafers, waveguides and HBM stacks—not yet another chatbot veneer. infrastructure will capture the lasting cash flows Follow the photons; that’s where the next 20× hides. Follow the photons; that’s where the next 20× hides.

The writer is smart, but don't just like, take their word for it. #DoYourOwnResearch before making any investment decisions or decisions regarding your health or security. (Do not regard any of this content as professional investment advice, or health advice)

This story contains new, firsthand information uncovered by the writer.

Copper

Crunchbase

Every

VC Funding is Shifting from Gen-AI Apps to Deep Infrastructure

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

Beyond the Usual Doom: Five AI Dangers Nobody Is Talking About

AI Crypto Coins: When the Power of AI Meets the Blockchain

Many Workers Still Feel Unprepared to Navigate AI in the Workplace

The AI Infrastructure Alliance and the Evolution of the Canonical Stack for Machine Learning

Why I Left Red Hat

The Principles to Keep In Mind When Building a Modern Datalake for Your AI Infrastructure

Beyond the Usual Doom: Five AI Dangers Nobody Is Talking About

AI Crypto Coins: When the Power of AI Meets the Blockchain

Many Workers Still Feel Unprepared to Navigate AI in the Workplace

The AI Infrastructure Alliance and the Evolution of the Canonical Stack for Machine Learning

Why I Left Red Hat

The Principles to Keep In Mind When Building a Modern Datalake for Your AI Infrastructure

Light-Mode

Classic

Newspaper

Minty

Dark-Mode

Neon Noir

Minty

HN StartUps