How to Use Open Source LLMs in AutoGen Powered by vLLM

Video Description

In this video, I would like to talk about creating agents in AutoGen with Open Source LLMs. USEFUL LINKS: Colab notebook for AutoGen w/ GPT-4 - https://colab.research.google.com/drive/1nq20eu_T3vFklHIv8781zfnW2d3BgISZ?usp=sharing Colab notebook for AutoGen w/ Phi-2 - https://colab.research.google.com/drive/1xee3xdatViM4pespvLVVOrHJ8sB1MgO5?usp=sharing Tutorial on Medium: https://levelup.gitconnected.com/adding-one-function-your-autogen-app-can-use-open-source-llms-locally-b1074639685f AutoGen Docs: https://microsoft.github.io/autogen vLLM Docs: https://docs.vllm.ai/en/latest/models/supported_models.html MY CONNECT: Buy me a coffee - https://ko-fi.com/yeyuh Business Inquiries - [email protected] X: https://x.com/Yeyu2HUANG Discord - http://discord.gg/KPTCE4CEmp Email Subscription - https://yeyu.substack.com/ Exclusive service - https://ko-fi.com/yeyuh/tiers