Deep-dive into the AI Hardware of ChatGPT

Video Description

With our special offer you can get 2 years of NordPass with 1 month free for a personal account: https://www.nordpass.com/highyieldnordpass Or use code highyieldnordpass at checkout. Business accounts (must register with a biz domain) can get a free 3-month trial of NordPass: https://www.nordpass.com/highyieldbusiness with code highyieldbusiness in the form. .... What hardware was used to train ChatGPT and what does it take to keep it running? In this video we will take a look at the AI hardware behind ChatGPT and figure out how Microsoft & OpenAI use machine learning and Nvidia GPUs to create advanced neural networks. Support me on Patreon: https://www.patreon.com/user?u=46978634 Follow me on Twitter: https://twitter.com/highyieldYT Links The Google research paper that changed everything: https://arxiv.org/abs/1706.03762 The OpenAI research paper confirming Nvidia V100 GPUs: https://arxiv.org/abs/2005.14165 0:00 Intro 0:28 AI Training & Inference 2:22 Microsoft & OpenAI Supercomputer 4:08 NordPass 5:57 Nvidia Volta & GPT-3 9:05 Nvidia Ampere & ChatGPT 13:23 GPT-3 & ChatGPT Training Hardware 14:41 Cost of running ChatGPT / Inference Hardware 16:06 Nvidia Hopper / Next-gen AI Hardware 17:58 How Hardware dictates the Future of AI