AI's Hourglass Figure
Economic value is going to accrue at the top, and the bottom, of the AI stack
Happy Sunday and welcome to Investing In AI. If you haven’t done so already, check out our AI Innovator’s Podcast. We are taking a 2 week break for the holidays but have one more episode to be posted this year about a review of 2024 in AI, and some 2025 predictions. But, as is common with AI, we just recorded the last episode a few days ago and there have already been some technical announcements that make it out of date. Such is life in AI.
Today I want to write about where economic value is going to accrue in the emerging AI tech stack. I’ve been a little bit negative this year on pure application software, and much of it has been influenced by tweets like the one below, from Chamath, earlier this year.
For 15 years now, we’ve had a SaaS movement where some of your defensibility was just the maturity of your software product and the fact that as you become more feature-rich it is difficult for a competitor to take business away from you. But as AI makes software easier and easier to create, it will change the build vs buy decisions of large corporations, and increase competition at the application layer as more people can offer solutions that are slightly differentiated. Lower costs mean you can serve smaller more niche markets profitably. The process, along with the benefits and challenges, is well described by my friend Eric Koziol in his post on personalized software in Embracing Enigmas.
The title for this post was inspired by a conversation with an AI friend recently where we were discussing the implications of this squeezing of the application layer. I believe that where we are going to see value in AI is at the top and bottom of the stack, not the middle.
By the “top of the stack” I mean agents. While I admittedly don’t have a strong thesis yet on who wins in agents, and why, I do think the agent market will be an oligopoly of a few platforms. Those platforms will have great economics, much like mobile app stores or other application marketplaces do today.
By the “bottom of the stack” I mean AI chips and the low level infrastructure software that runs them. There is an explosion of innovation at this level that has received several billion dollars in financing over the past few years, and is still nascent, generating maybe $300M - $500M in revenue in total across all the non-GPU AI hardware companies.
I think the TAM of AI hardware, that people are estimating at $400B - $500B by end of the decade will be 5-6x that. It will be several trillion dollars. Why? Because AI is effectively taking human tasks and pushing them down through the stack to become compute workloads. And the workloads are so different for so many AI use cases that I believe several AI chip companies will be wildly successful.
Now, one word of caution - there are always some specific opportunities at every level of the stack. There will be a few software markets that don’t get squeezed because not enough people know how to define the requirements of the software to effectively instruct AI how to design it. And there will always be some pockets of opportunity with unique and unusual and differentiated data sets. (But I think in the case of data sets we are overestimating how many truly unique and defensible ones are out there.)
So what I believe is, you want to be at the agentic level close to the customer, or at the hardware/infra level close to the computation. And markets in between will be squeezed on profitability. Thus the “hourglass” figure of AI.
If you are building at the top or bottom of the stack, and raising a Seed or Series A, please reach out. Our latest HalfCourt Ventures fund is much larger and we are playing slightly later in the startup game. The firm is surrounded by super smart AI partners with deep experience taking AI products to market, and all the unique challenges that represents, so we hope you consider us as a potential partner.
Thanks for reading, and enjoy the holidays.