GPT-5 is FINALLY Released...

Yeah, but is that the AGI we were waiting for? Here we have GPT5. Sam Olman teased just a few months ago said it's coming this summer and we finally got it. I'm hearing a lot of still mixed but pretty good things about it. And it's pretty gosh darn cheap as well for a reason that you don't think about but we'll get into that. $125 per million input tokens and $10 per million output tokens, which puts it in line with Gemini 2.5. There are three models been released with a fourth on the way. You've got GBT5 Mini, which is 25 cents uh input, $2 out. GBT5 Nano, which is uh 5 cents per million input, 40 cents out, which again, just two really fast performance models and alternatives to Big Daddy. 400,000 input context window with 120,000 output. Token caching offers 90% uh discount on those things. So that's a pretty big savings to be honest. Knowledge cut off date is the September 30th of the year 2024. So still, you know, it's funny how behind we are in some ways, but GPT5 outperforms or matches models like Claude 4, Grock 4 at a fraction of the cost. And again, we we'll get into that. One thing that's really really cool about um GBT5 and very very very impressive is they've got hallucinations down to 1%. And you know obviously ideally we want 0% hallucinations but you ask a human humans probably hallucinate more than 1%. Do you know what I mean? Much more. Yeah. And you got sync I can't say it over agreeableness. In simple words, it's going to agree with you less, which is a good thing. These AI models in general, whatever you tell them, they tend to agree with you, even if you are dead wrong. It's available through the API, but you should see this roll out um in your chatbt throughout the week. It's a unified system that answers more questions and deeper reasoning model thinking model for harder problems and real and a real-time router that quickly decides which is something you've been after for a while which use based on conversation type complexity and tool needs and your explicit intent. For example, if you say think hard about this in the prompt, it will obviously think and do more things. So that real time routting is really cool. You just you just set it and forget it. a real good general model. Apparently is good for like coding as well and specifically UI. It's it's really quite a modern clean UI. Do you know it's just struck me actually maybe a lot of the UI sucks because the training data is only up until like you know 2023 or something like that whereas we've reestablished a bit of a trend over the last year which GPT5 might be up to date on. They show one piece of a UI. It blew my mind when I saw it. I was like, I don't think good thing. Oh, this thing. Yeah, it was all right. I mean, I didn't think that was I mean, that game was symbolic of its UI. I think the glowy neon thing. But, you know, when a when a um a website is AI generated because they will all they all have their distinctive look and feel. And I think we'll start to see, oh, that's a GPT5 generated website. I want to try this model and see if it can help me in cursor. Uh because I I showed my like I generate I'm back in cursor right and I showed what I was coding with cursor with AI. I made a react app and I showed it to my uh developer to I could which we had on um two episodes uh before. He had a stroke. He saw my code and he just had a stroke. how bad the code was like it it was everything was depreciated like uh the syntax was we had just so many errors and the code extensions like even was wrong like so many things was wrong you're the results you get from AI is average at best it's always going to be best yeah so it's important thing to remember like you think you you're you're a new de not you I'm on I'm you know someone is a new developer they come in they think they can write code because they've got AI now. Not even close, buddy. Like, it's it's it's a good starting point and I I absolutely implore you to enjoy it and and launch that website and whatever, but understand there's so much more to it. But anyway, let's let's keep going with the GPT5 stuff. Uh once users limits are reached, a mini version of each model handles the remaining queries. That's nice, isn't it? And they they uh in future they plan to integrate these capabilities into a single model. That's interesting. It's like mixture of experts, but it's like not because that that little expert is probably a a distilled version of the of the knowledge it needs. Really cool. Here we go. The GPT5 is our strongest coding model to date. It shows particular improvements in complex front-end generation and debugging larger repository. debugging and then front end generation which I've only really seen like again onepage single page things rather than actually um creating a decent code base as were though it can debug larger code bases which is pretty cool um and I saw the video and a lot of people were oneshotting their their their basic piece of software which is really cool I mean this is just nice is it oh I can play it hey it's got sound and everything it's nice creative expression and writing thing which traditionally Claude was good for. Healthbench making an appearance again being good at healthbench which is cool to see. The thing we haven't discussed I alluded to earlier is that now while this is the same price as Gemini 2.5 Pro $125 in $10 out the efficiency of the return tokens and the reasoning tokens that it takes to actually give you a response is so much better than Gemini. I think the real real number we need to look at when it comes to price is price price per like token or price per prompt or something like that. So, you know, whilst again it's it's already I think 2.5 is pretty reasonable, the fact that it's the same price but it's way more efficient means your average prompt takes far less tokens, far far less. So, it's really cool. So, I don't know how much GBT 5 Pro is going to be, but that is that is a model that's going to be coming. But, you can see some of the stats here. It's really uh but up against some of these sort of numbers here and again from a price like I think 03 is quite expensive. I think 03 is like really quite expensive. I forgot what it is. Frontier math obviously doing very very well here is being out 04 mini and 03 here. Yeah, but from what I see it's literally 0.4% better than GPT chat GPT agent plus browser. Like isn't it like a very small increment incremental change? Well, here's Yeah, you're right. Like 20. What are you talking about? Here to this and then this to this. Is that what you're talking about? Yeah, I think little I think this is why I don't care too much. I mean, it's good little, you know, good little indicator these graphs and stuff like that, but at the end of the day, it comes down to real world usage. the the the feeling is that the real world usage is actually something to to take note of. But saying that uh these graphs were very different 24 hours ago. So we had 52% showing more than six like 69 and 30 were both the same here and it was showing that 52 was um higher than these sorts of things. But now they've they've fixed these graphs now. Good for agentic and tool use as well which we love as coders. long horizon tasks and obviously tool usage and things like that. I think that's the biggest letdown on this model is that I think we were expecting like kind of like a Google moment of this model can do all of this stuff like it can make videos like if you put in you can give videos as a source or you can you can make code from a video in Gemini 2.5. I think I think we were expecting something more than just a textbased input output thing. Do you know what I mean? The multimodal capabilities are just not not impive at all to be honest. They they accept images. That's it. So from what I understand, the Chat GPT5 is just overall a bit cleaner, a bit cheaper, a bit like having everything put together, but it's not a revolutionary model. It's not significantly better than the previous models. It's just one simple, cheaper, faster model that does it's consistent as well. Like when it comes to hallucinations, did I just see something? Yeah. around that around here. Um, less agreeable, fewer unnecessary emojis. Um, I think they said something about M dashes as well. Yeah, but is that the AGI we were waiting for? We are going to give you fewer unnecessary emojis and m dashes. I already have this, by the way, in my prompts everywhere. Lacking. It's It's lacking the understanding of the way that humans actually write. And we unfortunately we write with grammatical errors. We don't Yeah. Again, we don't we don't write m dashes. Do you know what I mean? Yeah. GBT5 is out there in the world. We're all very excited. Um, what more can you say? This is part of a larger conversation on my show, Command AI, which we stream live every single week. We discuss the news and all things related to AI in the world of design and web. Catch us next week and join in the banter.