Next-gen semiconductors and computer chips are the lifeblood of today’s digital economy. With artificial intelligence and the rise of ubiquitous computing, chip-maker companies are filling the demand for cutting-edge hardware.

Arm’s Ami Badani lays down the company’s ubiquitous computing vision.

That hardware must be designed in adherence to changing standards in schematics and chip design. Companies such as Arm Holdings PLC are shaping the architecture of tomorrow’s computer processors.

“If you look at Arm, we’re pretty much the compute platform for everyone,” said Ami Badani (pictured), chief marketing officer of Arm. “We have about 70% of the world on devices that are on Arm. Whether that’s a smartphone that all of us use every day to advanced servers that are running artificial intelligence. Everything now is shifting to high performance, low power; and that’s the opportunity in front of us at Arm. What we believe is we want to be the platform for ubiquitous computing for everyone.”

Badani spoke with theCUBE Research’s Dave Vellante and John Furrier at the AI Infrastructure Silicon Valley – Executive Series event, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed the trend for next-gen semiconductors as they focus on streamlined optimizations, AI democratization and power efficiency.”

Arm’s ubiquitous computing vision

Arm is tasked with pushing the boundaries of what’s possible, ensuring that the semiconductor sector remains at the heart of technological progress. At the core of Arm’s strategy is its commitment to ubiquitous computing. This vision isn’t just about maintaining a dominant position in the market; it’s about shaping the future of computing, according to Badani.

“I’m an AI optimist by nature, and so I think the world of computing is going to be shaped by AI,” she said. “I think Arm is going to be at the heart of all of that in designing systems. We’re looking at how to make AI democratized on the CPU, and that’s really where Arm comes in. How do you run AI workloads on the CPU in a more performant manner, in a more efficient manner than you ever were before?”

As AI becomes increasingly integral to various industries, from healthcare to education, Arm aims bring performant AI to the mass market. This approach ensures that AI technologies are accessible and scalable, paving the way for more widespread adoption across different sectors.

The company envisions a world where AI is pervasive, transforming industries and creating new opportunities. As the landscape shifts, data centers are undergoing their transformation. The traditional model of rack-and-stack servers is giving way to supercomputer clusters that can handle the immense demands of AI workloads, according to Badani.

“It’s a new way to think about your data center,” she said. “From the chip to the systems to the interconnect and the networking. All of that stuff is the way you think about your data. We’ve fundamentally changed the way that most people think about their data centers from chips then to systems now.”

With software in mind, Arm focuses on optimizing the entire stack — from firmware and drivers to the app layer — ensuring that Arm-based devices are powerful and efficient. Illustrating this is the company’s recent introduction of KleidiAI, an open-source library with optimized micro-kernels for AI.

“It’s kernel-level optimizations that integrate into the frameworks themselves, whether it’s Llama or  Gemini or pick your framework,” Badani said. “We’re able to leverage all of those CPU accelerations that I was talking about earlier, the Vector Extensions, and all of that gluware just works.”

Here’s the complete video interview, part of SiliconANGLE’s and theCUBE Research’s coverage of the AI Infrastructure Silicon Valley – Executive Series event: 

Photo: SiliconANGLE