Stream Processing Design Patterns | Capital One
AI Council
@aicouncilconfAbout
AI Council is the "No BS" AI conference. Since 2013 we've been bringing together the brightest minds in data to share insider industry knowledge, technical architectures and best practices on building the cutting edge data processing systems and tools of the future. We are deeply technical, vendor neutral & community-driven, and we exhibit our values each year during our flagship global event. Across 3 days, join top AI researchers, lead engineers, data scientists, CTOs, founders, Heads of Data, executives, investors and community organizers who are all coming together IRL to share valuable insights as they build the future of data together. We also operate Zero Prime Ventures - a first check VC fund for Day 0 engineer-founders.
Video Description
Get the slides: https://www.datacouncil.ai/talks/stream-processing-design-patterns ABOUT THE TALK: Streaming applications can be designed to balance or favor one or more of latency, throughput, memory consumption, or CPU load. In order to scale growing real-time applications well, properties like replayability, at-least-once and exactly-once processing, and out-of-order processing drive decisions that need to be made inside the streaming application and by data producers and consumers. This presentation discusses some useful design patterns for streaming applications that help deliver great value and an exceptional digital personalization experience to our customers, with personalized responses for Capital One's Eno chatbot as an example. ABOUT THE SPEAKER: Andreas Markmann is Manager of Data Engineering at Capital One and tech lead for the Potomac Clickstream project, where he works with engineers and partner teams to democratize strongly scaling data efficiently for the benefit of customer experience. Before joining Capital One, he created efficient parallel classical and quantum dynamics algorithms for the simulation of laser-molecule and nuclear fusion reactions. He has a PhD in Theoretical Physics from University College London and an MSc in Pure Mathematics from Queen Mary and Westfield College London. He financed his undergraduate degree improving his English as a sightseeing tour guide in Berlin, Germany and volunteered as a rock climbing, swimming, and programming coach for underserved communities. ABOUT DATA COUNCIL: Data Council (https://www.datacouncil.ai/) is a community and conference series that provides data professionals with the learning and networking opportunities they need to grow their careers. Make sure to subscribe to our channel for more videos, including DC_THURS, our series of live online interviews with leading data professionals from top open source projects and startups. FOLLOW DATA COUNCIL: Twitter: https://twitter.com/DataCouncilAI LinkedIn: https://www.linkedin.com/company/datacouncil-ai Facebook: https://www.facebook.com/datacouncilai Eventbrite: https://www.eventbrite.com/o/data-council-30357384520
Stream Processing Essentials
AI-recommended products based on this video
TP-Link Tapo 1080P Indoor Security Camera for Baby Monitor, Dog Camera w/Motion Detection, 2-Way Audio Siren, Night Vision, Cloud & SD Card Storage, Works w/Alexa & Google Home (Tapo C100)
