Wes Bos Built a Game to Destroy His World

You can turn your own room, your own living house, your whatever you have, your real world into a gaming environment that you can actually game in. Command AI So, this is probably one of the most fun projects I've seen in a while. You can turn your own room, your own living house, your whatever you have, your real world into a gaming environment that you can actually game in. And that in like really, really, really high-quality. Like photorealistic. And it's insane how good this is. So, this is a project by Best Boss, which is also open source. So, that's also amazing that it's open source. So, look what he has done. He has scanned his entire house. And in this case, we see only his room. And all of that was done by AI, but also with like his direction. He's a developer. He knows obviously what he's doing. So, he shows his room. And then he shows the idea that he wanted to do this type of like thing, but it's really difficult to do it with the existing tools. And with existing tools like there there are like 3D like lidar tools that you can use on your iPhone. He shows them that they are not really good. So, so he's like, "You know what? I'm going to create my own app." So, he creates his own iPhone app that creates this 3D uh environment. But also, as it creates the environment, it notes where the iPhone is, the orientation, and every information about it, and snaps a picture. So, it's the 3D environment captured with the lidar from the phone and the photos on top of it. And then he uses the room API from Apple, which I didn't know about. I knew about the other two things. And once you have this amount of data, and you can give it to clear an LLM to process it and create it, he shows how some of this is programmatic like a Python I believe it's a Python code that he runs locally and it checks the scenes and checks the outputs and make sure to iterate until it gets it really close. So it's like the real you see how the real image and the rendered it does it iteratively until it gets it right. And once it's right you can then do crazy stuff with it. So he he can then create this game in it. He can walk in it. He can do this kind of like shot where he lays down everything [clears throat] every object that is scanned in the room on a surface which is really really cool. So again we we talked about the the whole Apple casement that was done by real humans and people were really happy that it wasn't done by AI and my point was kind of like you know what it can be done like you can create cool stuff with AI. It doesn't you don't have to be anti-AI. I mean look at this how cool this is without AI this probably would take him month month of work and it has been probably a week or so project. And the project is open source. You can just point your agent at this repo and be like set all of that up for me and then it Now you know this goes right back to what we were saying right at the beginning of the show which is now that you know that this stuff is possible like you can now vibe code [clears throat] this thing but you know that the room API exists you know that lidar can be a way to you know capture a room's depth and all that sort of stuff cuz we all have it you know. Maybe I will like scan my garden and create a a sniper game there. [laughter] That'd be really fun. This is part of a larger conversation on my show Command AI which we stream live every single week. We discuss the news and all things related to AI in the world of design and web. Catch us next week and join in the banter. Command AI