Mistral Large vs GPT4 - Practical Benchmarking!
Trelis Research
View ChannelAbout
Trelis LTD is a research company based in Dublin, founded by Ronan McGovern 🎥 Watch Trelis AI Tutorials on here on Youtube: youtube.com/@TrelisResearch 🛠 Build & Deploy Faster: Fine-tuning, Inference, Audio, Evals, Robotics and Vision Tools at Trelis.com 💻 Need compute? Get a sign-up bonus on Runpod, affiliate link: https://runpod.io?ref=jmfkcdio 💡 Need Consulting? Get Technical Assistance OR Market Insights: https://forms.gle/2VXzrBzpvm1BmG6e7 💸 Starting a new project or venture? Apply for a Trelis Grant or Investment: https://trelis.com/trelis-ai-grants/
Latest Posts
Video Description
➡️ One-click Fine-tuning & Inference Templates: https://github.com/TrelisResearch/one-click-llms/ ➡️ Trelis Function-calling Models (incl. OpenChat 3.5): https://trelis.com/function-calling/ ➡️ ADVANCED-fine-tuning Repo: https://trelis.com/advanced-fine-tuning-scripts/ ➡️ ADVANCED-inference Repo: https://trelis.com/enterprise-server-api-and-inference-guide/ ➡️ Trelis Newsletter: https://Trelis.Substack.com ➡️ Tip Jar and Discord: https://ko-fi.com/trelisresearch Affiliate Link (supports the channel): - RunPod - https://tinyurl.com/4b6ecbbn VIDEO RESOURCES: -Carlini Website: https://nicholas.carlini.com/ -Carlini Github: https://github.com/carlini/yet-another-applied-llm-benchmark -Trelis fork w/ Custom LLM: https://github.com/TrelisResearch/yet-another-applied-llm-benchmark TIMESTAMPS: 0:00 A practitioner's guide to evaluating LLMs 00:45 Nicolas Carlini's LLM Benchmark Blog Post 1:15 Benchmarking results of GPT4 vs Claude vs Gemini vs Mistral 4:16 Mistral Large vs Mixtral vs OpenChat vs Qwen 11:32 Running custom evaluations using Runpod 26:26 Final Thoughts
Upgrade Your Kitchen Now
AI-recommended products based on this video
Portable Air Conditioner, Air Conditioner Portable with 3 Speeds, 3 Mist Settings, 1200ml XL Water Tank, 2~8h Timer, Portable Ac Unit, Small Mini Air Conditioner, Personal Air Cooler Fan for Bedroom
Conair Ceramic Long Barrel XL Curling Iron, 1 ½” Barrel Produces Classic Curls – for use on Medium and Long Hair, Hair Curler
ICEPURE Pitcher Water Filter Replacement for Brita® Standard Water Filter, Brita® Pitchers and Dispensers,Classic OB03, Everyday, UltraMax, Metro+, XL, Mavea® 107007 35557 and More NSF Certified 6PACK
ThermoMaven Professional Meat Thermometer Digital, 1-Second Truly Instant Read, NIST Certified Accurate to ±0.5℉, Ultra Bright LED Screen, 100% Waterproof, Motion-Sensing Wake/Sleep, Black
TRAUSI Instant Read Meat Thermometer, Fast & Accurate Digital Food Thermometer with Backlight, Waterproof & Magnet for Grilling, Cooking, BBQ, Smoker, Baking, and Candy Making Black
ESR for iPhone 16 Pro Case (4 in 1) Set, Translucent Matte Case with Screen Protector, Compatible with MagSafe, Military-Grade Protection, Classic Series, Frosted Black
2-in-1 Stainless Steel Pet Grooming Comb Set with Dense & Bristles for Dogs and Cats - ABS Handle, Self-Cleaning, 20cm
BBQ Rib Skinner, Rib Prep Pro, Professional Boning Tongs Boning Knife Set for Perfect Ribs, Ergonomic Handle Precise Cutting, Ultimate Grilling Gift for BBQ Enthusiasts & Grill Masters
17 MILE Black Cross Earrings for Men, 28 Pieces Stainless Steel Long Chain Dangle Piercing Hoop Earrings Set for Gifts
3 4 5 Year Old Girl Gifts, Exssary Kids Knife Set for Real Cooking Toys for 3 4 5 6-8 Year Old Girls Montessori Toddler Kitchen Tools Cutting Board Knives Birthday Gift Girls Toys Age 4-6 7-10 Pink
3D Spiral Apples Silicone Molds for Baking | Food Grade Mousse Cake Chocolate Molds | Reusable Baking Molds Silicone Shapes (3.46x3.46x2.09in)
Smart Hydroponics Growing System, LetPot 12 Pods Indoor Garden, 24W Light, App&WiFi Control, Water Shortage Remind, 20" Adjustable Rod, 5.5L Tank, Herb Garden for Home Kitchen, Stainless Steel
Rib Prep Pro, BBQ Rib Skinner, Rib Membrane Remover Stainless Steel Tool, Kitchen Grill Gadget for Rib Prep, with Arc Clamp & Non-Slip Grip, for Bar-B-Q Enthusiast, Chef, Easy Membrane Removal (1pcs)
Electric Grill Brush, Stainless Steel Power Roller Blasts Rotating Cleaning Brush with Built-in Led Lights, Rechargeable BBQ Brush Cleaner for Outdoor BBQ Bathroom and Kitchen (Brown/1PC)