How to Use 2 (or more) NVIDIA GPUs to Speed Keras/TensorFlow Deep Learning Training
Jeff Heaton
View ChannelAbout
Videos about my machine learning projects. ** Follow Me on Social Media! GitHub: https://github.com/jeffheaton Twitter: https://twitter.com/jeffheaton Instagram: https://www.instagram.com/jeffheatondotcom/ Discord: https://discord.gg/3bjthYv Patreon: https://www.patreon.com/jeffheaton
Latest Posts
Video Description
Dual GPU systems are becoming much more of a "deep learning thing" than a "gamer thing". But what will two (or more) GPUs on a single system actually get you? In this video, I show how to actually use two GPU's and how it can nearly cut your training time in half; under the right circumstances. We make use of a Lenovo P920 with dual Quadro GTX 8000 GPUs. Code here: https://github.com/jeffheaton/present/blob/master/youtube/gpu/keras-dual-gpu.ipynb Install TensorFlow GPU: Windows: https://www.youtube.com/watch?v=PnK1jO2kXOQ Linux: https://www.youtube.com/watch?v=dj-Jntz-74g Which GPU to get? https://www.youtube.com/watch?v=pWzlL51oqRo ** Follow Me on Social Media! GitHub: https://github.com/jeffheaton Twitter: https://twitter.com/jeffheaton Instagram: https://www.instagram.com/jeffheatondotcom/ TicTok: https://www.tiktok.com/@heatonresearch? Discord: https://discord.gg/3bjthYv Patreon: https://www.patreon.com/jeffheaton
Fix Your iPhone Today
AI-recommended products based on this video

Spigen Case for iPhone 15, iPhone 14, and iPhone 13, Ultra Hybrid MagFit Designed for Apple iPhone 15/14/13 - Crystal Clear

JETech Silicone Case for iPhone 13 6.1-Inch, Silky-Soft Touch Full-Body Protective Phone Case, Shockproof Cover with Microfiber Lining (Black)
![[ 3+3 Pack] LK 3Pack iPhone 13 Screen Protector 6.1-inch with 3Pack Camera Lens Protector, Anti-Scratch Easy-Installation,9H Hardness, HD Tempered Glass Film Global Recycled Standard](https://m.media-amazon.com/images/I/714PYxCQxbL._AC_UL960_FMwebp_QL65_.jpg)
[ 3+3 Pack] LK 3Pack iPhone 13 Screen Protector 6.1-inch with 3Pack Camera Lens Protector, Anti-Scratch Easy-Installation,9H Hardness, HD Tempered Glass Film Global Recycled Standard

SURPHY Silicone Case Compatible with iPhone 13 Case 6.1 inch (2021), with Camera Protection Liquid Silicone Soft Gel Rubber Phone Case Cover with Microfiber Lining (Pink) Global Recycled Standard

INIU Power Bank, USB C in&Out Slimmest 10000mAh Portable Charger, Triple 3A High-Speed Charge External Battery Pack, Flashlight Phone Charger for iPhone 16 15 14 13 12 Samsung S22 S21 Google LG iPad

JOREST 38Pcs Small Precision Screwdriver Set, Tool Gifts for Men, Christmas Gifts for him with Torx T5, T6, Repair Tool Kit for MacBook, Computer, Laptop, iPhone, PS4 PS5, Xbox, Switch, Glasses

Outdoorfun 24 in 1 DIY Screwdriver, 2025 Upgrade Magnetic Screwdriver Set, Multifunctional 24 in 1 Magnetic Ratchet Screwdriver Set Toolbox for Household (1set)

Soleilwear Mini Electric Screwdriver Set, 52 in 1 Precision Electric Screwdriver Cordless with 48 Magnetic Bits, Repair Tool Kit with Tweezers and Pry Bar
![[ 3+3 Pack] LK 3Pack iPhone 13 Screen Protector 6.1-inch with 3Pack Camera Lens Protector, Anti-Scratch Easy-Installation,9H Hardness, HD Tempered Glass Film Global Recycled Standard](https://m.media-amazon.com/images/I/714PYxCQxbL._AC_UL960_FMwebp_QL65_.jpg)
[ 3+3 Pack] LK 3Pack iPhone 13 Screen Protector 6.1-inch with 3Pack Camera Lens Protector, Anti-Scratch Easy-Installation,9H Hardness, HD Tempered Glass Film Global Recycled Standard

Spigen Case for iPhone 15, iPhone 14, and iPhone 13, Ultra Hybrid MagFit Designed for Apple iPhone 15/14/13 - Crystal Clear

JETech Silicone Case for iPhone 13 6.1-Inch, Silky-Soft Touch Full-Body Protective Phone Case, Shockproof Cover with Microfiber Lining (Black)
![[ 3+3 Pack] LK 3Pack iPhone 13 Screen Protector 6.1-inch with 3Pack Camera Lens Protector, Anti-Scratch Easy-Installation,9H Hardness, HD Tempered Glass Film Global Recycled Standard](https://m.media-amazon.com/images/I/714PYxCQxbL._AC_UL960_FMwebp_QL65_.jpg)
[ 3+3 Pack] LK 3Pack iPhone 13 Screen Protector 6.1-inch with 3Pack Camera Lens Protector, Anti-Scratch Easy-Installation,9H Hardness, HD Tempered Glass Film Global Recycled Standard

SURPHY Silicone Case Compatible with iPhone 13 Case 6.1 inch (2021), with Camera Protection Liquid Silicone Soft Gel Rubber Phone Case Cover with Microfiber Lining (Pink) Global Recycled Standard

Spigen Case for iPhone 15, iPhone 14, and iPhone 13, Ultra Hybrid MagFit Designed for Apple iPhone 15/14/13 - Crystal Clear

JETech Silicone Case for iPhone 13 6.1-Inch, Silky-Soft Touch Full-Body Protective Phone Case, Shockproof Cover with Microfiber Lining (Black)
![[ 3+3 Pack] LK 3Pack iPhone 13 Screen Protector 6.1-inch with 3Pack Camera Lens Protector, Anti-Scratch Easy-Installation,9H Hardness, HD Tempered Glass Film Global Recycled Standard](https://m.media-amazon.com/images/I/714PYxCQxbL._AC_UL960_FMwebp_QL65_.jpg)
[ 3+3 Pack] LK 3Pack iPhone 13 Screen Protector 6.1-inch with 3Pack Camera Lens Protector, Anti-Scratch Easy-Installation,9H Hardness, HD Tempered Glass Film Global Recycled Standard

SURPHY Silicone Case Compatible with iPhone 13 Case 6.1 inch (2021), with Camera Protection Liquid Silicone Soft Gel Rubber Phone Case Cover with Microfiber Lining (Pink) Global Recycled Standard

JETech Case for iPhone 13 Pro 6.1-Inch, Non-Yellowing Shockproof Phone Bumper Cover, Anti-Scratch Clear Back (Clear)

iPhone Charger Cord Lightning Cable (Apple MFi Certified) 6/6/10ft 3 Pack iPhone Cable Fast Charging Long Apple Charger Cable for iPhone 13 13 Pro 12 Pro 11 SE Max XS XR X, iPad Mini Air, iPod, AirPod
![5 Pack [MFi Certified] iPhone Charger 3ft,USB to Lightning Cable 3 Foot,Original Fast iPhone Charging Cord for iPhone 14 Pro Max/iPhone 13 Pro/12 Pro Max/12/11/Se2022/XR/X/8/iPad, White](https://m.media-amazon.com/images/I/71dLb64qYLL._AC_UL960_FMwebp_QL65_.jpg)
5 Pack [MFi Certified] iPhone Charger 3ft,USB to Lightning Cable 3 Foot,Original Fast iPhone Charging Cord for iPhone 14 Pro Max/iPhone 13 Pro/12 Pro Max/12/11/Se2022/XR/X/8/iPad, White
![iPhone Charger Fast Charging [Apple MFi Certified] USB C to Lightning Cable 6FT USBC to Lightning Cable Nylon Braided Type C Cord for iPhone 14 13 12 11 Pro Max XR XS X 8 7 6 Plus SE, iPad](https://m.media-amazon.com/images/I/517jTqwo1nL._AC_UL960_FMwebp_QL65_.jpg)
iPhone Charger Fast Charging [Apple MFi Certified] USB C to Lightning Cable 6FT USBC to Lightning Cable Nylon Braided Type C Cord for iPhone 14 13 12 11 Pro Max XR XS X 8 7 6 Plus SE, iPad

Spigen Case for iPhone 15, iPhone 14, and iPhone 13, Ultra Hybrid MagFit Designed for Apple iPhone 15/14/13 - Crystal Clear

JETech Silicone Case for iPhone 13 6.1-Inch, Silky-Soft Touch Full-Body Protective Phone Case, Shockproof Cover with Microfiber Lining (Black)
![[ 3+3 Pack] LK 3Pack iPhone 13 Screen Protector 6.1-inch with 3Pack Camera Lens Protector, Anti-Scratch Easy-Installation,9H Hardness, HD Tempered Glass Film Global Recycled Standard](https://m.media-amazon.com/images/I/714PYxCQxbL._AC_UL960_FMwebp_QL65_.jpg)
[ 3+3 Pack] LK 3Pack iPhone 13 Screen Protector 6.1-inch with 3Pack Camera Lens Protector, Anti-Scratch Easy-Installation,9H Hardness, HD Tempered Glass Film Global Recycled Standard

SURPHY Silicone Case Compatible with iPhone 13 Case 6.1 inch (2021), with Camera Protection Liquid Silicone Soft Gel Rubber Phone Case Cover with Microfiber Lining (Pink) Global Recycled Standard
![[ 3+3 Pack] LK 3Pack iPhone 13 Screen Protector 6.1-inch with 3Pack Camera Lens Protector, Anti-Scratch Easy-Installation,9H Hardness, HD Tempered Glass Film Global Recycled Standard](https://m.media-amazon.com/images/I/714PYxCQxbL._AC_UL960_FMwebp_QL65_.jpg)


