Cloud costs aren’t actually dropping dramatically

I’ve noticed a lot of buzz in the Silicon Valley about cloud costs “dropping dramatically.” Entrepreneurs, VCs, and the media write about this trend, claiming that it’s enabled a new wave of startups in fields like artificial intelligence and large scale data processing. Many editorials allege that new tech and increased competition has brought down cloud costs dramatically over the last few years — fueling new, valuable companies. An from , a VP at Point Nine Capital: example Nathan Benaich It’s my belief that artificial intelligence is one of the most exciting and transformative opportunities of our time. There’s a few reasons why that’s so … The costs of compute and storage are both , while the computational capacity of today’s processors is growing. plummeting by orders of magnitude , an investor at Spark Capital, : John Melas-Kyriazi echoes this sentiment Machine learning (ML) and narrow forms of artificial intelligence (AI) have officially reached the mainstream. The explosion of innovation we’re seeing in AI/ML stems from a series of rapid technological advances over the last few decades: faster/cheaper computers (per Moore’s Law), variable-cost cloud computing … Many reference Moore’s Law as reason for the “order of magnitude” improvements in cloud pricing. Others go so far as to create their own theorems; for example, , which (CEO of ) proposes as the idea that “over the history of cloud, a unit of computing power price is reduced by 50 percent approximately every three years.” Bezo’s Law Greg O’Connor AppZero Clearly, many bright minds are bullish on the rapid decrease in cloud costs and the subsequent rise of innovative startups that can ride this wave. But are cloud prices actually falling? I have often made this claim myself as the founder of a startup that relies on cloud storage and processing. But after a month of expensive cloud costs, I wanted to validate this trend by looking at historical costs. Because cloud offerings are so varied, there can be many different ways to measure cost. However, there are two main areas that matter for any startup: and . I dove into the to see if the prices for these cloud services were actually falling “dramatically” and found that the trends were not as obvious as many claim. compute storage Internet Archive Price trends from 2014–2018 I looked at pricing on the Google Cloud Platform for both (Google’s VMs, competitor to AWS EC2 Instances) and (similar to AWS S3). I used the to compare pricing back to 2014. Compute Engine Cloud Storage Internet Archive Compute As of Jan 3, 2018, these are for Compute Engine on GCP: the prices For the sake of comparison, I focused on , a standard offering, priced at per hour. Note that, as of this year, these prices depend on the server region — this screenshot is of the default region (Iowa), which is generally cheaper than other options. n1-standard-8 $0.38 I compared these prices with those from the past two years. : January 12, 2017 And : January 23, 2016 The pricing for the same was per hour two years ago. This 5% price drop over two years is hardly an order of magnitude better. The current prices of VMs in Northern Virginia today are actually ($0.425). n1-standard-8 $0.40 more expensive In March 2015, the same VM cost : $0.504 The same price from November 2014, the earliest snapshot I could find in the Internet Archive: So Google Compute Engine prices dropped 20% between 2014–2016 and 5% from 2016–2018. For certain locations, Google Compute Engine costs have not dropped in the last two years. A drop exists, but it seems far from “dramatic”. at all Storage If computing power isn’t dropping by an order of magnitude, then perhaps some of the excitement stems from the falling price of storage. A dramatic drop in storage (and associated data transfer) costs would enable smaller companies to run analysis on large data sets and move more data to the cloud. Cloud storage costs stem from two main sources: per GB storage, or the space taken by the files, and network transfer, or essentially the cost of downloading the files. Like computing power, there are a few nuances that can cause price variation, like the physical location of the stored files. However, if we look at the standard pricing on Google Cloud Storage today, we see the price of storage lies at around : $0.026 per GB The network transfer rates hover around per GB for up to 1 TB: $0.12 Using the internet archive, we can compare the today prices to those from December of 2014 (the earliest snapshot available, from over 3 years ago). Surprisingly, the main costs of Google Cloud Storage haven’t changed at all since the earliest snapshot available in the Internet Archive — over 3 years ago. If your startup has been counting on cloud costs to fall, you haven’t had much luck for the last 3 years. What about AWS, or other cloud providers? I chose to do analysis in this article on Google Cloud for the sake of consistency, because the pricing pages are more clear. The AWS pricing pages are much more nuanced and do not show prices as clearly. But if we look through the for articles on price reductions for AWS instances, we’ll notice that the last US based price reduction was back in , meaning that AWS didn’t cut prices for cloud services in the US at all for all in 2017. And in the price reduction of November 2016, only Northern Virginia machines were affected. Even in that specific region, price cuts were consistent with what we see with Google Cloud — around 5%. Hardly the order of magnitude drop that many have been waiting for. AWS News Blog November 2016 A full analysis of other top cloud providers is out of scope for this article, but a cursory observation of top US-based cloud providers shows a similar trend (or lack thereof). For example, if we look at the for Digital Ocean, another leading cloud provider, we can see that their standard plan with 2G Memory, 2 cores, 40BG SSD, and 3TB transfer costs . current pricing plans $20 / month Now we can compare this to their prices from January of 2014, . four years ago You can see that paying $20 / month (in red) will buy the . For Digital Ocean, . Many leading cloud providers exhibit the same sticky prices. same exact cloud setup as today cloud costs haven’t come down at all in the last four years Implications The rise of artificial intelligence is undoubtedly an important trend, but the idea that new companies will emerge as a result of dropping cloud costs isn’t supported by the data. We can already see evidence that startups that bet on this trend are in trouble. Last month, the popular video sharing platform , citing an inability to build a sustainable business. Vidme shut down Storing and delivering video is becoming less expensive, but remains extremely costly … When we launched in 2014, we projected that infrastructure costs would decline due to increased competition in the CDN and data storage industries. While marginal prices have fallen dramatically over the past few years, our aggregate costs still outpaced our ability to generate meaningful revenue. Cloud costs may have dropped a little, but not anywhere close to enable a meaningful new wave of startups betting on this trend. Our product, , is an . When we started, we also bet on storage prices to fall. But, we quickly realized that if we didn’t get our cloud costs under control, we would quickly be spending a ton of money. Even uploading and downloading only around 500 short videos a day was costing us over $50 a single day in network transfer fees. Some days our S3 bill would be over $100 dollars. For the month of December, our AWS bill was over $600. That might not seem like a lot of money to a big company, but it is a lot of money for a bootstrapped startup in its early days of life. Kapwing online video editor It took a considerable engineering effort to bring this spend under control. We stopped allowing file hotlinking, we removed uploads after a certain period of time, and we got smarter about how we upload and download videos. When we first started, we assumed that cloud costs were so low that they weren’t something we would have to worry about until we were at a fairly large scale. Instead, they turned out to be something we needed to worry about from day 1. The promised dramatic drop of cloud costs hasn’t come, and doesn’t seem to be coming. Artificial intelligence startups will certainly still rise, but their success will not be fueled by a drop in costs. Rather, their success will come in the form of deep pockets of VCs or partnerships with large players to access the necessary infrastructure to create meaningful technology. This necessity means that the next great wave of startups might not be artificial intelligence companies at all, but rather businesses built on a solid financial foundation from the beginning. This article was originally published on the Kapwing Blog .