Flink's Table & DataStream API: A Perfect Symbiosis
Flink Forward
View ChannelAbout
Apache Flink® is a powerful and easy-to-use open-source system for data stream processing with a very active developer and user community, one of the most active big data projects in the Apache Software Foundation. Visit the Apache Flink website for more information: https://flink.apache.org/ Flink Forward is the conference for Apache Flink and the stream processing communities. Join core Flink committers, new and experienced users, and thought leaders to share experiences and best practices in stream processing, real-time analytics, event-driven applications, and managing mission-critical Flink deployments in production. Be sure to check out www.flink-forward.org
Latest Posts
No results found. Try different keywords.
Video Description
The Table API is not a new kid on the block. But the community has worked hard on reshaping its future. Today, it is one of the core abstractions in Flink next to the DataStream API. The Table API can deal with bounded and unbounded streams in a unified and highly optimized ecosystem inspired by databases and SQL. Various connectors and catalogs integrate with the outside world. But this doesn't mean that the DataStream API will become obsolete any time soon. In this talk, we would like to demo what Table API is capable of today. We present how the API solves different scenarios: as a batch processor, a changelog processor, or a streaming ETL tool with many built-in functions and operators for deduplicating, joining, and aggregating data. We discuss the main differences between Table and DataStream APIs and elaborate on their preferred usage. We also show hybrid pipelines in which both APIs interact in symbiosis and contribute their unique strengths. 0:00 Intro 1:00 What is Flink? 3:48 Flink's APIs 14:17 Interoperability 15:57: Flink Demo 33:19 Summary
Streamline Your Data Workflow
AI-recommended products based on this video
