Could the era of colossal data centers be coming to an end? Imagine a future where the power of a data center fits in the palm of your hand. This isn’t just sci-fi speculation—it’s a growing conversation in the tech world. Perplexity CEO Aravind Srinivas recently dropped a bombshell on a podcast: someday, your smartphone might replace the need for massive data centers altogether. But here’s where it gets controversial: is this a realistic future, or just wishful thinking? Let’s dive in.
In a chat with host Prakhar Gupta, Srinivas argued that personalized AI tools could soon run directly on our devices, cutting out the need to rely on remote data centers. And this is the part most people miss: Apple’s AI system, Apple Intelligence, already does this for some features, using specialized chips in their latest devices. Microsoft’s Copilot+ laptops are following suit. But there’s a catch: these are premium gadgets, and most devices today simply aren’t powerful enough to handle AI on their own—yet.
Jonathan Evans, director of Total Data Centre Solutions, puts it bluntly: “It’s a long-term ‘if and when’ scenario.” Meanwhile, the data center industry is booming, with 100 new facilities under construction in the UK alone. Nvidia CEO Jensen Huang even calls them “AI factories,” essential for advancing AI technology. But is bigger always better? Some experts aren’t so sure.
Traditionally, data centers are massive warehouses packed with computers handling everything from streaming to banking. Yet, I once heard about a data center the size of a washing machine in Devon, UK, that was heating a public swimming pool. Skeptical? So was I—until I learned about a British couple heating their home with a data center in their shed, or a professor using a GPU under his desk to warm his office. Small is becoming the new big, and it’s not just a quirky trend.
Mark Bjornsgaard, founder of DeepGreen (the company behind the swimming pool data center), believes every public building should house a small data center, working together in a network and providing heat as a bonus. “London is just one giant data center waiting to happen,” he says. Amanda Brock of OpenUK agrees, suggesting derelict buildings and closed shops could be repurposed into mini data centers. And if you think that’s bold, Avi Shabtai of Ramon Space is looking to space—literally. He envisions small, scalable data centers in orbit, offering efficiency and flexibility.
But here’s the kicker: what if AI itself is shrinking? Large Language Models (LLMs) are powerful but error-prone, partly because they’re designed to do everything from diagnosing cancer to writing Taylor Swift-style lyrics. Businesses are catching on, opting for smaller, bespoke AI tools trained on their own data. These tools are more accurate, require less computing power, and can often run on-site. Dr. Sasha Luccioni of Hugging Face notes, “We’re seeing a shift from massive models to smaller, tailored ones that run locally.”
But here’s where it gets controversial: Could a network of small data centers pose a security risk? Prof. Alan Woodward argues that smaller targets are less catastrophic if breached, unlike large centers, which are “big points of failure.” Think of the recent AWS outages. Plus, smaller data centers could reduce the environmental impact of these energy-hungry giants.
So, is the future of data centers small, decentralized, and closer to home? Or will the giants continue to dominate? What do you think? Let’s debate this in the comments—I’m all ears!
