A Metadata Service for Data Abstraction, Data Lineage & Event-based Triggers | WeWork

AI Council January 2, 2019
Video Thumbnail
AI Council Logo

AI Council

@aicouncilconf

About

AI Council is the "No BS" AI conference. Since 2013 we've been bringing together the brightest minds in data to share insider industry knowledge, technical architectures and best practices on building the cutting edge data processing systems and tools of the future. We are deeply technical, vendor neutral & community-driven, and we exhibit our values each year during our flagship global event. Across 3 days, join top AI researchers, lead engineers, data scientists, CTOs, founders, Heads of Data, executives, investors and community organizers who are all coming together IRL to share valuable insights as they build the future of data together. We also operate Zero Prime Ventures - a first check VC fund for Day 0 engineer-founders.

Video Description

Get the slides: https://www.datacouncil.ai/talks/marquez-a-metadata-service-for-data-abstraction-data-lineage-and-event-based-triggers ABOUT THE TALK: At WeWork, it's critical that we understand the complete context for all datasets. We also want to be able to explore dependencies between jobs and the datasets they produce and consume. To do this, WeWork needs metadata. In this talk I will focus on Marquez, a core service for the collection, aggregation and visualization of a data ecosystems metadata. Marquez maintains the provenance of how datasets are consumed and produced while providing global visibility into job runtime. ABOUT THE SPEAKER: Willy Lulciuc is a Data Engineer at WeWork and works on the Project Marquez team in San Francisco, making datasets discoverable and meaningful. Previously, he worked on the real-time streaming data platform powering BounceX, and before that, designed and scaled sensor data streams at Canary. When he's not reviewing code and creating indirections, he can be found experimenting with analog synthesizers. ABOUT DATA COUNCIL: Data Council (https://www.datacouncil.ai/) is a community and conference series that provides data professionals with the learning and networking opportunities they need to grow their careers. Make sure to subscribe to our channel for more videos, including DC_THURS, our series of live online interviews with leading data professionals from top open source projects and startups. FOLLOW DATA COUNCIL: Twitter: https://twitter.com/DataCouncilAI LinkedIn: https://www.linkedin.com/company/datacouncil-ai Facebook: https://www.facebook.com/datacouncilai Eventbrite: https://www.eventbrite.com/o/data-council-30357384520

Beat the Heat: Car AC Essentials

AI-recommended products based on this video

Loading...
Onlyone Water Dental Flosser, 300ML Portable Oral Irrigator for Teeth, 4 Modes and 5 Jet Tips,Rechargeable Irrigation Cleaner,Electric Flossing Machine Power Flossers & Irrigator Accessories Black

Onlyone Water Dental Flosser, 300ML Portable Oral Irrigator for Teeth, 4 Modes and 5 Jet Tips,Rechargeable Irrigation Cleaner,Electric Flossing Machine Power Flossers & Irrigator Accessories Black

(8,890)
$23.39
FREE delivery Sat, Aug 9 on $35 of items shipped by Amazon
50K+ bought in past month
Loading...
Portable Handheld Turbo Fan, 5 Gear Wind, Battery Operated, Up to 12 Working Hours, 3 IN 1 Hand Fan with Air Turbo Tech Cooling Fan for Outdoor Activities, Travel, Beach (Black)

Portable Handheld Turbo Fan, 5 Gear Wind, Battery Operated, Up to 12 Working Hours, 3 IN 1 Hand Fan with Air Turbo Tech Cooling Fan for Outdoor Activities, Travel, Beach (Black)

(3,296)
$16.19
FREE delivery Mon, Aug 11 on $35 of items shipped by Amazon
50K+ bought in past month
Loading...
COOWPS Switch Case for Nintendo Switch and Switch OLED Model, Portable Full Protection Carrying Travel Bag with 18 Game Cards Storage for Switch Console Pro Controller Accessories Black

COOWPS Switch Case for Nintendo Switch and Switch OLED Model, Portable Full Protection Carrying Travel Bag with 18 Game Cards Storage for Switch Console Pro Controller Accessories Black

(2,497)
$24.99$22.99
FREE delivery Mon, Jun 16 on $35 of items shipped by Amazon
800+ bought in past month
Loading...
Wireless Bluetooth Mouse for Apple iPad iPhone MacBook Android Samsung Tablet Phone Dual-Mode Rechargeable 2.4G Portable Computer Mice for Windows Laptop Notebook PC Mac Desktop USB Receiver (Black)

Wireless Bluetooth Mouse for Apple iPad iPhone MacBook Android Samsung Tablet Phone Dual-Mode Rechargeable 2.4G Portable Computer Mice for Windows Laptop Notebook PC Mac Desktop USB Receiver (Black)

(1,960)
9.99
PrimeFREE delivery Saturday, June 14 on orders shipped by Amazon over $35
500+ bought in past month
Loading...
PULIDIKI Car Cleaning Gel Car Clean Putty, Universal Car Interior Cleaner Slime, Perfect Cleaning Kit Supplies, Auto Detailing Tools Accessories, Dust Remover Gifts for Men Women
Best Seller

PULIDIKI Car Cleaning Gel Car Clean Putty, Universal Car Interior Cleaner Slime, Perfect Cleaning Kit Supplies, Auto Detailing Tools Accessories, Dust Remover Gifts for Men Women

(95,477)
$6.99
PrimeFREE delivery Sun, Sep 21 on $35 of items shipped by Amazon
20K+ bought in past month
Loading...
MARSDOCK 45W Charger for Nintendo Switch - 15V 2.6A AC Adapter Fast Charging with 5FT USB C Cord - Compatible with Switch Lite, OLED, Steam Deck - Support TV Mode
Best Seller

MARSDOCK 45W Charger for Nintendo Switch - 15V 2.6A AC Adapter Fast Charging with 5FT USB C Cord - Compatible with Switch Lite, OLED, Steam Deck - Support TV Mode

(3,053)
$14.99
FREE delivery Wed, Jul 2 on $35 of items shipped by Amazon
9K+ bought in past month
Loading...
Universal Travel Adapter PD 35W, ENSOBO Worldwide Travel Plug Adapter with 2 USB A and 3 USB C Ports, High Speed Worldwide AC Outlet Plugs for UK, EU, AU, Asia (White)

Universal Travel Adapter PD 35W, ENSOBO Worldwide Travel Plug Adapter with 2 USB A and 3 USB C Ports, High Speed Worldwide AC Outlet Plugs for UK, EU, AU, Asia (White)

(92)
Loading...
Kaistyle for Magsafe Car Mount【20 Strong Magnets】 Magnetic Phone Holder for Car Phone Holder Mount Dash Cell Phone Holders for Your Car Accessories for Women Men for iPhone 17 Pro Max 16 15 14 13 12 ClimatePartner certified
Best Seller

Kaistyle for Magsafe Car Mount【20 Strong Magnets】 Magnetic Phone Holder for Car Phone Holder Mount Dash Cell Phone Holders for Your Car Accessories for Women Men for iPhone 17 Pro Max 16 15 14 13 12 ClimatePartner certified

(16,688)
$9.99
FREE delivery Sun, Sep 21 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
LISEN Retractable Car Charger, 69W USB C Car Accessories Adapter for iPhone 17 USB C Charger Fast Charging, Gifts for Women Men, Travel Essentials, for iPhone 17 Pro Max Air 16 15 14 13 12 Samsung S25
Best Seller

LISEN Retractable Car Charger, 69W USB C Car Accessories Adapter for iPhone 17 USB C Charger Fast Charging, Gifts for Women Men, Travel Essentials, for iPhone 17 Pro Max Air 16 15 14 13 12 Samsung S25

(10,850)
$16.99
FREE delivery Sun, Sep 21 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
Car Carplay Cable for iPhone 17/17 Pro/Air/16e/16/15 Pro Max/Plus Cable, 2Pack USB A to USB C for CarPlay USBC Cord, iPad, Galaxy, Pixel, Android Accessories Charging Wire Type-C Car Charger Cord 3FT

Car Carplay Cable for iPhone 17/17 Pro/Air/16e/16/15 Pro Max/Plus Cable, 2Pack USB A to USB C for CarPlay USBC Cord, iPad, Galaxy, Pixel, Android Accessories Charging Wire Type-C Car Charger Cord 3FT

(3,346)
$7.51
FREE delivery Fri, Oct 3 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
PULIDIKI Car Cleaning Gel Car Clean Putty, Universal Car Interior Cleaner Slime, Perfect Cleaning Kit Supplies, Auto Detailing Tools Accessories, Dust Remover Gifts for Men Women
Best Seller

PULIDIKI Car Cleaning Gel Car Clean Putty, Universal Car Interior Cleaner Slime, Perfect Cleaning Kit Supplies, Auto Detailing Tools Accessories, Dust Remover Gifts for Men Women

(95,477)
$6.99
PrimeFREE delivery Sun, Sep 21 on $35 of items shipped by Amazon
20K+ bought in past month
Loading...
MARSDOCK 45W Charger for Nintendo Switch - 15V 2.6A AC Adapter Fast Charging with 5FT USB C Cord - Compatible with Switch Lite, OLED, Steam Deck - Support TV Mode
Best Seller

MARSDOCK 45W Charger for Nintendo Switch - 15V 2.6A AC Adapter Fast Charging with 5FT USB C Cord - Compatible with Switch Lite, OLED, Steam Deck - Support TV Mode

(3,053)
$14.99
FREE delivery Wed, Jul 2 on $35 of items shipped by Amazon
9K+ bought in past month
Loading...
Universal Travel Adapter PD 35W, ENSOBO Worldwide Travel Plug Adapter with 2 USB A and 3 USB C Ports, High Speed Worldwide AC Outlet Plugs for UK, EU, AU, Asia (White)

Universal Travel Adapter PD 35W, ENSOBO Worldwide Travel Plug Adapter with 2 USB A and 3 USB C Ports, High Speed Worldwide AC Outlet Plugs for UK, EU, AU, Asia (White)

(92)
Loading...
GOOACC - GRC-33 240PCS Bumper Retainer Clips Car Plastic Rivets Fasteners Push Retainer Kit Most Popular Sizes Auto Push Pin Rivets Set -Door Trim Panel Fender Clips for GM Ford Toyota Honda Chrysler
Best Seller

GOOACC - GRC-33 240PCS Bumper Retainer Clips Car Plastic Rivets Fasteners Push Retainer Kit Most Popular Sizes Auto Push Pin Rivets Set -Door Trim Panel Fender Clips for GM Ford Toyota Honda Chrysler

(76,396)
$10.92$10.37
FREE delivery Sun, Sep 21 on $35 of items shipped by Amazon
20K+ bought in past month
Loading...
PULIDIKI Car Cleaning Gel Car Clean Putty, Universal Car Interior Cleaner Slime, Perfect Cleaning Kit Supplies, Auto Detailing Tools Accessories, Dust Remover Gifts for Men Women
Best Seller

PULIDIKI Car Cleaning Gel Car Clean Putty, Universal Car Interior Cleaner Slime, Perfect Cleaning Kit Supplies, Auto Detailing Tools Accessories, Dust Remover Gifts for Men Women

(95,477)
$6.99
PrimeFREE delivery Sun, Sep 21 on $35 of items shipped by Amazon
20K+ bought in past month
Loading...
Duracell 2025 Lithium Battery, 4 Count (Pack of 1) Child Safety Features, Lithium Coin Battery for Key Fob, Car Remote, and other devices, CR2025 3 Volt (3V) Cell

Duracell 2025 Lithium Battery, 4 Count (Pack of 1) Child Safety Features, Lithium Coin Battery for Key Fob, Car Remote, and other devices, CR2025 3 Volt (3V) Cell

(13,663)
$6.19
FREE delivery Fri, Oct 3 on $35 of items shipped by Amazon
20K+ bought in past month
Loading...
GOOACC - GRC-33 240PCS Bumper Retainer Clips Car Plastic Rivets Fasteners Push Retainer Kit Most Popular Sizes Auto Push Pin Rivets Set -Door Trim Panel Fender Clips for GM Ford Toyota Honda Chrysler
Best Seller

GOOACC - GRC-33 240PCS Bumper Retainer Clips Car Plastic Rivets Fasteners Push Retainer Kit Most Popular Sizes Auto Push Pin Rivets Set -Door Trim Panel Fender Clips for GM Ford Toyota Honda Chrysler

(76,396)
$10.92$10.37
FREE delivery Sun, Sep 21 on $35 of items shipped by Amazon
20K+ bought in past month
Loading...
PULIDIKI Car Cleaning Gel Car Clean Putty, Universal Car Interior Cleaner Slime, Perfect Cleaning Kit Supplies, Auto Detailing Tools Accessories, Dust Remover Gifts for Men Women
Best Seller

PULIDIKI Car Cleaning Gel Car Clean Putty, Universal Car Interior Cleaner Slime, Perfect Cleaning Kit Supplies, Auto Detailing Tools Accessories, Dust Remover Gifts for Men Women

(95,477)
$6.99
PrimeFREE delivery Sun, Sep 21 on $35 of items shipped by Amazon
20K+ bought in past month
Loading...
Duracell 2025 Lithium Battery, 4 Count (Pack of 1) Child Safety Features, Lithium Coin Battery for Key Fob, Car Remote, and other devices, CR2025 3 Volt (3V) Cell

Duracell 2025 Lithium Battery, 4 Count (Pack of 1) Child Safety Features, Lithium Coin Battery for Key Fob, Car Remote, and other devices, CR2025 3 Volt (3V) Cell

(13,663)
$6.19
FREE delivery Fri, Oct 3 on $35 of items shipped by Amazon
20K+ bought in past month
Loading...
NOCO Boost GB40: 1000A UltraSafe Jump Starter – 12V Lithium Battery Booster Pack, Portable Jump Box, Power Bank & Jumper Cables - for 6.0L Gas and 3.0L Diesel Engines
Best Seller

NOCO Boost GB40: 1000A UltraSafe Jump Starter – 12V Lithium Battery Booster Pack, Portable Jump Box, Power Bank & Jumper Cables - for 6.0L Gas and 3.0L Diesel Engines

(117,789)
$99.95$75.43
FREE delivery Sun, Sep 21
30K+ bought in past month
Loading...
Munchkin Brica Sun Safety Car Window Shade with Heat Alert, Helps Block UVA/UVB Rays, 2 Pack, Black
Best Seller

Munchkin Brica Sun Safety Car Window Shade with Heat Alert, Helps Block UVA/UVB Rays, 2 Pack, Black

(12,316)
$9.77
FREE delivery on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
Qifutan Dash Mounted Holders Phone Holders for Your Car Phone Mount for Car Windshield Dashboard Air Vent Universal Hands Free Automobile Cell Phone Holder Fit for iPhone Smartphone
Best Seller

Qifutan Dash Mounted Holders Phone Holders for Your Car Phone Mount for Car Windshield Dashboard Air Vent Universal Hands Free Automobile Cell Phone Holder Fit for iPhone Smartphone

(14,455)
$9.99
FREE delivery Sun, Sep 21 on $35 of items shipped by Amazon
10K+ bought in past month
Loading...
All-Purpose Stainless Steel Shower Squeegee for Shower Glass Door with 2 Adhesive Hooks, Bathroom Cleaner Tool Household Window Mirror Squeegee , Cleaning Tile Wall, Car, 10 Inch Silver
Best Seller

All-Purpose Stainless Steel Shower Squeegee for Shower Glass Door with 2 Adhesive Hooks, Bathroom Cleaner Tool Household Window Mirror Squeegee , Cleaning Tile Wall, Car, 10 Inch Silver

(13,593)
$9.49
FREE delivery Sun, Sep 21 on $35 of items shipped by Amazon
20K+ bought in past month
Loading...
Duracell 2025 Lithium Battery, 4 Count (Pack of 1) Child Safety Features, Lithium Coin Battery for Key Fob, Car Remote, and other devices, CR2025 3 Volt (3V) Cell

Duracell 2025 Lithium Battery, 4 Count (Pack of 1) Child Safety Features, Lithium Coin Battery for Key Fob, Car Remote, and other devices, CR2025 3 Volt (3V) Cell

(13,663)
$6.19
FREE delivery Fri, Oct 3 on $35 of items shipped by Amazon
20K+ bought in past month
Loading...
Portable Handheld Turbo Fan, 5 Gear Wind, Battery Operated, Up to 12 Working Hours, 3 IN 1 Hand Fan with Air Turbo Tech Cooling Fan for Outdoor Activities, Travel, Beach (Black)

Portable Handheld Turbo Fan, 5 Gear Wind, Battery Operated, Up to 12 Working Hours, 3 IN 1 Hand Fan with Air Turbo Tech Cooling Fan for Outdoor Activities, Travel, Beach (Black)

(3,296)
$16.19
FREE delivery Mon, Aug 11 on $35 of items shipped by Amazon
50K+ bought in past month
Loading...
Redragon RGPS-850W 80+ Gold 850 Watt ATX 3.0 & PCIe 5.0 Fully Modular Power Supply w/ 80 Plus Gold Certified, Compact 160mm Size, Smart ECO Low Noise RGB Fan, 100% Japanese Capacitors, Full Mod Cables

Redragon RGPS-850W 80+ Gold 850 Watt ATX 3.0 & PCIe 5.0 Fully Modular Power Supply w/ 80 Plus Gold Certified, Compact 160mm Size, Smart ECO Low Noise RGB Fan, 100% Japanese Capacitors, Full Mod Cables

(1,550)
114.99
PrimeFREE delivery Saturday, June 14
200+ bought in past month