ChatGPT O1 Preliminary test comparison with previous model test videos

Internet of Bugs September 21, 2024
Video Thumbnail
Internet of Bugs Logo

Internet of Bugs

View Channel

About

35 year software professional discussing software careers, quality, bugs, and AI. Special focus on LLMs generating code, and how programming might change as AI advances.

Video Description

I ran ChatGPT O1 through the same test I ran on other models in https://youtu.be/-ONQvxqLXqE and https://youtu.be/x0y1JWKSUp0 and this video summarizes what I found. The raw screencast of O1 code interactions is at https://youtu.be/7zpFMtfkuvA 00:00 Intro 00:30 Comparison to tests I ran with @Proof_news 01:10 ECM Prime Number Attempt 01:56 CodeCrafters HTTP Server challenge 02:47 Still can't do a developer job 03:14 But, an increase in code quality 03:40 More to come 03:55 Usability issues 04:14 About comparisons to a "smart PhD"

You May Also Like

Upgrade Your AI Chat Now

AI-recommended products based on this video

Loading...
Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

(22)
$423.35
FREE delivery Oct 8 - 10
Loading...
10.1 Inch Touch Portable Monitor IPS Screen 1366x768P 60Hz 400 Brightness 99% sRGB HDMI USB-C Monitors Switch for Xbox PS3/4/5 Laptop Compatible with Raspberry Pi, Mini Touch Screen

10.1 Inch Touch Portable Monitor IPS Screen 1366x768P 60Hz 400 Brightness 99% sRGB HDMI USB-C Monitors Switch for Xbox PS3/4/5 Laptop Compatible with Raspberry Pi, Mini Touch Screen

(1)
$99.99
FREE delivery Mon, Aug 11
Loading...
ELECROW 8 Inch Portable Monitor, 1280x800 Mini HD Display with Built-in Speakers, USB Powered, Non-Touch LCD Screen for Raspberry Pi, PC, Laptop, Jetson Nano, Game Consoles

ELECROW 8 Inch Portable Monitor, 1280x800 Mini HD Display with Built-in Speakers, USB Powered, Non-Touch LCD Screen for Raspberry Pi, PC, Laptop, Jetson Nano, Game Consoles

(49)
$117.29$102.21
$6.86 delivery Thu, Aug 14
Loading...
7 Inch Portable Monitor Touchscreen HD 1024x600 LED Display Dual HDMI Port Small Monitor for PC Raspberry Pi Laptop Computer Xbox PS4/5 Switch Built-in Speakers

7 Inch Portable Monitor Touchscreen HD 1024x600 LED Display Dual HDMI Port Small Monitor for PC Raspberry Pi Laptop Computer Xbox PS4/5 Switch Built-in Speakers

(61)
$68.99
FREE delivery Tue, Aug 12
Loading...
BrosTrend 1800Mbps WiFi 6 Linux WiFi Adapter for PC and Raspberry Pi 2+, Long Range USB WiFi Dongle Linux for Ubuntu, Mint, Debian, Kubuntu, Lubuntu, Zorin, Windows 11/10, Dual Band Wireless Antenna

BrosTrend 1800Mbps WiFi 6 Linux WiFi Adapter for PC and Raspberry Pi 2+, Long Range USB WiFi Dongle Linux for Ubuntu, Mint, Debian, Kubuntu, Lubuntu, Zorin, Windows 11/10, Dual Band Wireless Antenna

(288)
$54.14
FREE delivery Sun, Jun 22
Loading...
Logitech G435 Lightspeed and Bluetooth Wireless Gaming Headset - Lightweight Over-Ear Headphones, Built-in mics, 18h Battery, Compatible with Dolby Atmos, PC, Mobile - Black

Logitech G435 Lightspeed and Bluetooth Wireless Gaming Headset - Lightweight Over-Ear Headphones, Built-in mics, 18h Battery, Compatible with Dolby Atmos, PC, Mobile - Black

(14,873)
$49.99$39.99
FREE delivery Thu, Aug 21
400+ bought in past month
Loading...
Logitech G203 Wired Gaming Mouse, 8,000 DPI, Rainbow Optical Effect LIGHTSYNC RGB, 6 Programmable Buttons, On-Board Memory, Screen Mapping, PC/Mac Computer and Laptop Compatible - Black
Best Seller

Logitech G203 Wired Gaming Mouse, 8,000 DPI, Rainbow Optical Effect LIGHTSYNC RGB, 6 Programmable Buttons, On-Board Memory, Screen Mapping, PC/Mac Computer and Laptop Compatible - Black

(17,871)
$27.98$22.38
FREE delivery Tue, Oct 14 on your first order
500+ bought in past month
Loading...
Logitech G305 LIGHTSPEED Wireless Gaming Mouse, Hero 12K Sensor, 12,000 DPI, Lightweight, 6 Programmable Buttons, 250h Battery Life, On-Board Memory, PC/Mac - Black

Logitech G305 LIGHTSPEED Wireless Gaming Mouse, Hero 12K Sensor, 12,000 DPI, Lightweight, 6 Programmable Buttons, 250h Battery Life, On-Board Memory, PC/Mac - Black

(21,223)
$44.98
FREE delivery Tue, Oct 14
1K+ bought in past month
Loading...
Logitech G502 HERO High Performance Wired Gaming Mouse, HERO 25K Sensor, 25,600 DPI, RGB, Adjustable Weights, 11 Programmable Buttons, On-Board Memory, PC / Mac, Black
Best Seller

Logitech G502 HERO High Performance Wired Gaming Mouse, HERO 25K Sensor, 25,600 DPI, RGB, Adjustable Weights, 11 Programmable Buttons, On-Board Memory, PC / Mac, Black

(54,445)
$49.98$44.98
FREE delivery Tue, Oct 14
1K+ bought in past month
Loading...
CORSAIR iCUE Link XD5 RGB Elite LCD Pump-Reservoir Unit - D5 PWM Pump - 480x480 IPS LCD Screen - 22 Addressable RGB LEDs - 440ml Nylon Reservoir - White

CORSAIR iCUE Link XD5 RGB Elite LCD Pump-Reservoir Unit - D5 PWM Pump - 480x480 IPS LCD Screen - 22 Addressable RGB LEDs - 440ml Nylon Reservoir - White

(17)
$379.99
FREE delivery Sun, Aug 24
Loading...
CORSAIR iCUE Link XC7 RGB Elite CPU Water Block - Transparent Flow Chamber - 24 RGB LEDs - Fits Intel® LGA 1700, AMD® AM5 and Older - White

CORSAIR iCUE Link XC7 RGB Elite CPU Water Block - Transparent Flow Chamber - 24 RGB LEDs - Fits Intel® LGA 1700, AMD® AM5 and Older - White

(56)
$149.99$125.33
FREE delivery Sun, Aug 24
Loading...
CORSAIR Hydro X Series iCUE Link XH405i Custom Cooling Kit – Hardline Water Cooling Loop – XC7 Elite CPU Water Block – XD5 Elite D5 Pump Res – XR5 360mm Radiator – 3X QX120 RGB Fans

CORSAIR Hydro X Series iCUE Link XH405i Custom Cooling Kit – Hardline Water Cooling Loop – XC7 Elite CPU Water Block – XD5 Elite D5 Pump Res – XR5 360mm Radiator – 3X QX120 RGB Fans

(235)
$879.99
FREE delivery Sun, Aug 24
Loading...
NA to Clamp, Quick Release NA to Rail Lock Clamp with 1/4in 3/8in Thread, Standard NA to Clamp Adapter for Camera Cage Friction Arm Ball Head Cold Shoe Microphone Monitor

NA to Clamp, Quick Release NA to Rail Lock Clamp with 1/4in 3/8in Thread, Standard NA to Clamp Adapter for Camera Cage Friction Arm Ball Head Cold Shoe Microphone Monitor

(0)
$12.69
FREE delivery Jun 27 - Jul 10
Loading...
NA to Clamp, Quick Release NA to Rail Lock Clamp with 1/4in 3/8in Thread, Standard NA to Clamp Adapter for Camera Cage Friction Arm Ball Head Cold Shoe Microphone Monitor

NA to Clamp, Quick Release NA to Rail Lock Clamp with 1/4in 3/8in Thread, Standard NA to Clamp Adapter for Camera Cage Friction Arm Ball Head Cold Shoe Microphone Monitor

(0)
$12.69
FREE delivery Jun 27 - Jul 10
Loading...
Air Purifier for Home (3 Pack), Plug In Air Ionizers, Portable Negative Ion Generator, Air Freshener for Pet Odor, Kitchen Odor, Dust, Smoke Smell (White)

Air Purifier for Home (3 Pack), Plug In Air Ionizers, Portable Negative Ion Generator, Air Freshener for Pet Odor, Kitchen Odor, Dust, Smoke Smell (White)

(16)
$39.98
FREE delivery Tue, Nov 4
400+ bought in past month
Loading...
BLUETTI Solar Generator Elite 30 V2, 288Wh LiFePO4 Battery Backup 600W,AC Outlets (Power Lifting 1500W), 0-100% in 70 Min, for Camping, Road Trip, Outage (Solar Panel Optional) ClimatePartner certified
Best Seller

BLUETTI Solar Generator Elite 30 V2, 288Wh LiFePO4 Battery Backup 600W,AC Outlets (Power Lifting 1500W), 0-100% in 70 Min, for Camping, Road Trip, Outage (Solar Panel Optional) ClimatePartner certified

(26)
$218.99
FREE delivery Sep 5 - 17