Avoid premature Database Sharding

Hussein Nasser โ€ข April 3, 2021
Video Thumbnail
Hussein Nasser Logo

Hussein Nasser

@hnasr

About

Join me as we discuss various software engineering topics with examples and add fun elements to them. We always try to learn by example here in this educational Youtube channel which we believe is the right way to learn. I love Software engineering (especially the backend) and I strive to be a better software engineer every day. Join me on this journey and let us learn together. All opinions, suggestions, and tips I provide in all of this channel's content are my own. Information provided is for educational purposes only. Consider becoming a member to support the channel https://www.youtube.com/channel/UC_ML5xP23TOWKUcc-oAE_Eg/join Check out my courses https://courses.husseinnasser.com Stay awesome! Hussein Nasser, http://www.husseinnasser.com Feel free to shoot me an email [email protected] twitter: @hnasr

Video Description

Someone asked a question on Twitter and I thought it's interesting to answer it here in the show. I have a 2 million row table used in my CRUD python app, Iโ€™m worried that as the table grows my inserts will slow down, should I consider sharding my database or partition the table? thank you * inserts are fast, queries are slow 0:00 * inserts can be slow 3:00 * indexes/stored procedures * selects, updates and deletes can be slow 12:00 * add proper indexes. * simplicity wins, premature optimization is bad 15:20 * crazy things that people say as microservices day 1 scares me ๐ŸŽ™๏ธListen to the Backend Engineering Podcast https://husseinnasser.com/podcast ๐Ÿญ Backend Engineering Videos https://backend.husseinnasser.com ๐Ÿ’พ Database Engineering Videos https://www.youtube.com/playlist?list=PLQnljOFTspQXjD0HOzN7P2tgzu7scWpl2 ๐Ÿฐ Load Balancing and Proxies Videos https://www.youtube.com/playlist?list=PLQnljOFTspQVMeBmWI2AhxULWEeo7AaMC ๐Ÿ›๏ธ Software Archtiecture Videos https://www.youtube.com/playlist?list=PLQnljOFTspQXNP6mQchJVP3S-3oKGEuw9 ๐Ÿ“ฉ Messaging Systems https://www.youtube.com/playlist?list=PLQnljOFTspQVcumYRWE2w9kVxxIXy_AMo Become a Member https://www.youtube.com/channel/UC_ML5xP23TOWKUcc-oAE_Eg/join Support me on PayPal https://bit.ly/33ENps4 Stay Awesome, Hussein