AI Coding Comparison Challenge. 4 AIs build an HTTP Server in Python. See how they do.

Video Description

Company provided demo videos are awful, and I'm tired of them lying, glossing over errors and hiding what the AIs got wrong. So I made my own. The full, unredacted video is at https://www.youtube.com/watch?v=mikK5MoApQM where you can watch everything each AI did right and wrong. This video is a summarization of what happened, what I learned, what the different AIs did well or did poorly, who "won" and what recommendations I have based on these results. If you want to learn more about how Internet Software works, sharpen your skills, and have some fun, you can use this link: https://iob.fyi/CodeCrafters to sign up for CodeCrafters free and if you do decide to upgrade later, you'll get 40% off. 00:00 Why this AI demo video is different 02:24 The competitors 03:13 Caveat: Current Point in Time. Current versions of products Sept 2024 03:33 The Challenge 06:27 Problem One: "200 OK" 07:43 Problem Two: "404 Not Found" 09:33 Problem Three: Echo/Request Body 10:30 Summary So Far 11:25 Problem Four: User-Agent/Headers 13:02 Problem Five: Adding a Loop 13:15 Problem Six: Returning a File 14:10 Discussion of Results 15:14 Recommendations 15:19 Observations on Companies 16:19 Thanks to CodeCrafters.io for the playing field 16:34 Closing My video on Software Testing in an AI world, mentioned in this video: https://youtu.be/02FD59whT5A My video on Devin's Upwork demo: https://youtu.be/tNmgmwEtoWE My video on the Claude 3.5 Sonnet coding demo: https://youtu.be/x0y1JWKSUp0