Nvidia Ai Quotes

In AI, the lion’s share of the most advanced GPUs essential to the latest models are designed by one company, the American firm NVIDIA. Most of its chips are manufactured by one company, TSMC, in Taiwan, the most advanced in just a single building, the world’s most sophisticated and expensive factory. TSMC’s machinery to make these chips comes from a single supplier, the Dutch firm ASML, by far Europe’s most valuable and important tech company.

In the early 2010s, Nvidia—the designer of graphic chips—began hearing rumors of PhD students at Stanford using Nvidia’s graphics processing units (GPUs) for something other than graphics. GPUs were designed to work differently from standard Intel or AMD CPUs, which are infinitely flexible but run all their calculations one after the other. GPUs, by contrast, are designed to run multiple iterations of the same calculation at once. This type of “parallel processing,” it soon became clear, had uses beyond controlling pixels of images in computer games. It could also train AI systems efficiently.

Structural prediction and protein design, once considered impossible problems, are now solvable. Grigoryan explains that the complexity of a protein and its possible states surpasses the number of atoms in the universe. “Those numbers are extremely challenging for any computational tools to deal with,” he said. But he believes a skilled protein biophysicist can examine a particular molecular structure and deduce its potential functions, suggesting there may be learnable general principles in nature—exactly the sort of operation that a “universal prediction engine” such as AI should be able to figure out. Generate:Biomedicines has applied AI to examine and map molecules at the cell level, and Grigoryan sees the potential to extend the same technique to the entire human body. Simulating how the human body will react is orders of magnitude more complicated, but Grigoryan thinks it will be possible. “Once you see it working, it’s hard to imagine it doesn’t just continue,” he said, referring to the power of AI.

Now, as traditional computing programs are displaced by the operation of AI algorithms, requirements are once again shifting. Machine learning demands the rapid-fire execution of complex mathematical formulas, something for which neither Intel’s nor Qualcomm’s chips are built. Into the void stepped Nvidia, a chipmaker that had previously excelled at graphics processing for video games. The math behind graphics processing aligned well with the requirements for AI, and Nvidia became the go-to player in the chip market. Between 2016 and early 2018, the company’s stock price multiplied by a factor of ten.

And that’s not even close to the most expensive Nvidia product. Nvidia’s latest server rack system as of this writing, the Blackwell GB200 series, was specifically designed to train “trillion-parameter” AI models. It comes with seventy-two GPUs and costs $2 million to $3 million—the most expensive Nvidia machine ever made. The company’s top-end-product pricing isn’t merely increasing; it is accelerating.

Current AI models can now understand requests via context and because they can grasp natural conversational language. It is a major breakthrough. “The core of generative AI is the ability for software to understand the meaning of data,” Jensen said.16 He believes that companies will “vectorize” their databases, indexing and capturing representations of information and connecting it to a large language model, enabling users to “talk to their data.

Under Jensen Huang, Nvidia didn't just ride the AI wave; they built the surfboard, the wave pool, and then taught everyone how to surf through strategic bets on GPUs and CUDA

Notably, all eight Google scientists who authored the seminal “Attention Is All You Need” paper on the Transformer deep-learning architecture—which proved foundational for advancements in modern AI large language models (LLMs), including the launch of ChatGPT—soon after left Google to pursue AI entrepreneurship elsewhere. “It’s just a side effect of being a big company,” said Llion Jones, one of the coauthors of the Transformer paper.4 “I think the bureaucracy [at Google] had built to the point where I just felt like I couldn’t get anything done,” he added, expressing frustration with his inability to access resources and data.

Jensen himself has called AI a “universal function approximator” that can predict the future with reasonable accuracy. This applies as much in “high-tech” fields such as computer vision, speech recognition, and recommendations systems as it does in “low-tech” tasks such as correcting grammar or analyzing financial data. He believes that eventually it will apply to “almost anything that has structure.