Genie 3 is Genuinely Mindblowing

This is like genuinely mind-blowing. Genie 3, a new frontier for world models. It looks insane. You can generate 3D worlds via prompt. And and it's not just generating the 3D world and that's it. You can actually move through it using this kind of, you know, uh directional pad here. So there's prompt, take part in a show, horse show event, skiing the Alps. You can control yourself. Helicopter pilot. And this is all procedurally generated. And then you can prompt in real time. Look, give it a second. Hit man in chicken soup. So you in real time you can actually prompt. And then every frame is generated based on previous frames. It's re basically real time user input and using arrow keys. Um you can obviously change the scenes on the fly with text prompts. We saw a few elements there. Useful for simulating environments uh for like AI and robot training. I mean, you know, think of think of what this could actually do. So, I definitely think simulation training, which is mental in VR. So, no doubt this will be plugged into some sort of VR device or made into 3D and stuff like that because that can be really good for um obviously like military training and things like that, but like actual treatment as well, like psychosis and all the rest of it. So, but on the more lightart lighterarted side of things, creating real-time video games, movies and TV shows, it's limitless really. The sort of sorts of things you can generate and um it's only being used internally at Google. No public release announced. This is like genuinely mind-blowing. This is the unique position that uh Google have got themselves in. They can do so much because they own and operate the hardware as well as like they've got the full full stack, let's call it. So they can do really heavily computational things like this. Just imagine all the things that you can build with this. That that is insane to me. For example, Google maps. Have you thought about it? We have like 3D worlds already with Google maps and Apple Maps, but they are not very exact. They are not really detailed. They are not really nice. But we also have a lot of uh like images what are they called like street view images from Google. Now imagine combining these things and with this generative uh AI to create a replication of our world with every single detail in it and now take that and use it for so many things. For example, just the Google maps example is an obvious one but also gaming. Have you thought about gaming in your neighborhood like Call of Duty style? I mean, I used to when I was like 16, I used to play some custom DLC. So, we would uh edit maps, add things to them, and I always dreamt of having my neighborhood maybe, you know, with a little bit of like extra fun stuff added to it, and then play with my friends that were close to me. All we we were from the same neighborhood. play Call of Duty there. Theoretically, you can always create your own game, but now imagine how easy this gets with this model. Another thing, as you mentioned, for robotics, um they already have like some generative words for worlds for them. But with this, they robots could have almost a perfect replica of our world. That would be also very interesting to see uh how they can use it to to learn to learn and I don't know how this will be for like self-driving cars probably could they could use it as well. So it's not just robots uh self-driving cars also are type of robots but yeah I I think this is like super exciting. I'm just not sure why Google is not releasing it. Maybe because it's really costly. Like a video typically takes minutes to generate and now imagine this is kind of like a video in real time. They are probably running this on huge clusters of like probably like even potentially thousands of GPUs at the same time because it's not like a video for which you can wait to be generated. This is real time. So if you move, it has to move and that probably needs a lot of um GPU power. But with time, as we've seen in the past few years, we went from Will Smith spaghetti to now realtime worlds. It's just insane to me looking at like the history of how we got to Genie 3 as well. Game and Gen, no idea what that is, but it's uh 320p game specific. I don't really know what a lot of these these metrics mean, but like, you know, basically they've gone from a few seconds, and this is Genie2, the last one, which is 360p. We're up to 720p. I think that's an important distinction to make there. We're still over 720p, but it's, you know, still pretty good. 3D environments to general. I again, I don't know what general is. Um, limited keyboard, mouse actions, and this is promptable, promptable world. Again, don't really understand that, but you know, you can navigate around it. Um, we've gone from 10 to 20 seconds, which is pretty good, to multiple minutes. So, that's fantastic. Unlimited, right? If you get to multiple minutes, you could I I don't see a reason for it being limited because it can just look at the last two seconds and based on that continue generating. Or maybe maybe like it's something with the context. For example, in the website, they show a few trees that stay consistent in in the video or like what is it called? Like in the experience, they stay consistent. Yeah. So, if you look here, I mean, once it's generated all this, it's not generating anything new, you know, it's it's in the it's in the memory presumably. I don't know how this technology works, but you know, again, this character is running forward. it's already generated this stuff, but I guess there's perspectives and it changes perspectives. But yeah, without knowing the technology, I'm not too sure. But so there's a difference between Genie 2 and then Genie 3. So there's a lot more fidelity uh inside of Genie 3. It's this is everything's on max here from there's no nuance. There's no kind of subtlety in the in the image. So u and then obviously you can see here the interaction has been has ended. And and the other thing is is is physics as well. Real world physics. So there is an there is a cool one that I've this one here where it's like it's gonna it's going to bash through one of these lights now. Look. Boom. Like it's that real world physics that is really really um impressive as well. Look at this. Like this to me does not look 3D generated. This actually looks photo Yeah. realistic to me. I mean, the guy is barely moving, so this looks a bit naff, but like this all just looks like video footage. Like, it's actually a movie. So, what is this? Is this No, it's not 3D. It's they they literally just make video on the go. That's how I understand it. This is like video on demand. I think that would be like huge for the gaming industry. I don't know how storytelling with from AI will be, but so far from what we've seen also from uh V3 is called, right? the video generation that tool is just creating some frames but the interesting storytelling is still coming from humans. A more direct example would be the Yeti vlog side. It doesn't make up for bad storytelling when the joke is just rubb rubbish. Just because it looks cool and oh there's a yeti holding a a camera doesn't mean it's going to be very good. So uh