Report details Apple’s plan to use Nvidia chips for the Gemini-powered Siri - 9to5Mac

A new report from The Information shares fresh details on how the new Gemini-powered Siri will work under the hood. Here are the details. A few days ago, The Information reported on some of the technical aspects behind Apple’s AI plans for WWDC, including how the company is expected to use Nvidia chips through Google Cloud for some Siri queries. as part of an Apple agreement with Google, some user queries to a new version of Siri will run in Google Cloud on a licensed version of the search giant’s Gemini model. Apple recently approved the use of a privacy technology from Nvidia in that setting, suggesting it will use Nvidia AI chips for at least some of its computing needs in Google Cloud, according to people familiar with the matter. Now, The Information has published a new report, with fresh details on how Apple’s use of Nvidia chips is going to work: Specifically, Apple will tap into Google’s fleet of Nvidia’s Blackwell B200 data center chips, said the people. Apple will enable Nvidia’s confidential compute feature that encrypts data as it’s being processed on the chips. The Nvidia Blackwell B200 is one of Nvidia’s flagship data center GPUs for large-scale AI training and inference. It is based on Nvidia’s Blackwell architecture, which is the successor to Hopper. Nvidia positions Blackwell as a platform for running and training very large AI models (including trillion-parameter models), with major improvements in inference, memory bandwidth, and multi-GPU scaling compared with the Hopper architecture. As for the confidential compute feature, it is a hardware-based security system that protects data while it is actively being processed by Nvidia GPUs. According to Nvidia, the feature “preserves the confidentiality and integrity of AI models deployed on Rubin, Blackwell, and Hopper GPUs,” allowing “sensitive AI workloads to run securely at scale with near-native performance, even in shared or cloud environments.” Nvidia published a white paper on its confidential compute feature, and you can find it here. Back to the report, The Information notes that Apple’s “move diverges from strategy of attempting to control all the critical ingredients to its products,” adding that it’s “unclear how Apple’s previously launched server system, called Private Cloud Compute, will fit into the upcoming Siri product launch.” To read The Information’s full report, follow this link.