Claude Computer Use is INSANE!

I saved for the best to last cuz I really love this. This blew my socks off. Command AI So, Anthropic has just launched computer use research preview. Again, they seem to be tiptoeing around this for Claude Pro and Mac subscribers only on Mac OS. Letting Claude move move the cursor, click, type, complete forms all autonomously. You can even assign them from your remote control. And that's exactly what we're going to do. Basically, your Claude can now use your computer. And with your phone, you can use your Claude. So, you Basically, you with your phone, you're controlling your agent that spins off more agents to do stuff on your computer at the same time. Let's separate the two right now cuz there's two things we're talking about. Computer use is something something that you can just you can do through the Claude's desktop app. Computer use this is this is what we're talking about. But maybe last week they also launched dispatch, which allows you to message Claude desktop and tell it to do something. You could use Claude desktop last week and and tell it to do something, but you you didn't have access to computer use. But these two little puppies are match made in heaven um for yeah, just sending stuff off. So, I I've got Claude open here. And I've got my open Claude over there. And I was going to say something like open Final Cut Pro, render the video that opens, mark the Notion video database as edited, and text me that you've finished editing it. Let's see what happens there. See if it can understand. I'm hoping that turns on so you can see it in the background light up. So yes, so now it's asking for Final Cut Pro permission. I was hoping that would light up, but there we go. So it's asking for Final Cut Pro permission. Even better. Right, I'm going to go get it. Hang on. Stay here. Stay here. Yeah. The dramatic effect. Okay. Oh, it's doing things. Because I'm so excited that the computer is doing something. So I can see I can confirm it's rendering. There's a little icon at the top there. I didn't know what video was going to pop up, so I just render Yeah. So I could have probably told it which video to render actually, cuz I've got If anyone knows anything about Final Cut, all of my projects are down the left-hand side there. So I could tell it, but I just told it to render the first video that So until this is finished So it's finished? So it's finished? Yeah, we're done. Now it's Hopefully it's going to open up Notion. And it's Okay, so this is what we're going to get into. So there is a sequence of things that it will do. Right? Because this is not efficient. You got to think this is sending off screenshots to Claude uh to Anthropic and then taking action every 30 seconds or 15 seconds or whatever. So now allow Claude to use Notion update page. So this is fallback number one. What happened? Cuz it's not saying anything on my phone. So I'm just going to quit the video. So just say continue. Just the future this should this should pop up on my This will pop up on my phone, so it's going to do that. So the first fallback it's going to see if it can do it through any of the the that Claude has access to. I have access to Notion, the connector. If it can't do that, then it's going to go to your browser. It's going to go to Claude Chrome extension. Oh. Hear that? That sounds like a text message. If we look here, Claude is short, edited, done. And then, let's see where that text message went to. Cuz it This is I'm going to explain something. See that bottom one? See how there's two there? This is the problem This is a new feature that got released just the other day, plugins, that it can use iMessage. Which, as you said, it's against terms of service. It does it on your PC, on your laptop? It does it on my laptop. So, it does it on my laptop. The issue here, you can see that it's mess it it needs to message yourself. So, the blue message is me messaging, and then the gray is me receiving it. So, I've been using it every single message is got is doubled up. There's where it failed, so that's fine. But, you've got the blue, and then you've got the the gray. Yeah. So, that's the problem with that. They'll fix that. They'll fix that, or they'll whatever. So, I don't get the I don't get the um the the excitement around the iMessage thing. Unless I'm doing something wrong there, you let me know if I'm doing something wrong. But, I don't get the excitement about the iMessage integration that they launched yesterday. However, how [ __ ] cool was that? Yeah, that that That's really cool. Like, I've been using Dispatch all week. Yeah. Like, since they announced it, I was like, holy [ __ ] And And then, computer use these two go so good hand in hand. The reason why you might Dispatch is one, which is the thing I was talking about that I was building, which is an MCP. MCP, I can't use an MCP on Claude app on my phone. However, if I dispatch it where a MCP is running on my computer, then Yeah. that's that's a good reason to use dispatch. That's why I love dispatch. So, yeah. Um You can do if you can if you can use a skill or if you can use like Yeah, if you you can use a skill, you can just use normal Claude, but you Yeah, you get so much you can get computer That's how you get computer use from from away from your computer. Use that. But, don't get me wrong, you can use computer use on the main machine that you're on. Um you just might find it a bit annoying that it's got this orange border around you and it's also interfering with the It's obviously sending a screenshot of your screen off to Anthropic to make its next action. So, which is why I was like open Claude when open Claude got released and everyone was talking about Mac minis and I'm like, you do not freaking You do not need a Mac mini for open Claude. It doesn't need all of that power. It doesn't need Unless you're running local models, that I think I'll be making a video next week how I replaced open Claude with Claude code. Finally. Like actually. Like not just like a whatever. The only thing that I I forgotten if we spoke about this in the intro or not. The only thing that I really want is schedule tasks are a massive thing in open Claude and this is what my whole video about this feature was on my channel. The um is scheduling and uh having tasks just run automatically. There is a schedule task. We have an AI producing this podcast, right? This podcast is produced by AI. I don't think we talk about it enough. I get a message I get a message three times a day about articles that it thinks the AI thinks that we should um include on the week's episode. And then it goes through a whole notion thing. But what happens is that this I will receive during this episode. So I probably need to tweak that a little bit and say don't tell me don't don't bother on a Friday afternoon. But I don't know whether you can see this, but those are messages and then I respond and say I respond and say include article one, include article two, or whatever. That interaction, that back and forth, is something I cannot do with Claude schedule and Claude code. Like a schedule will run and it's run on that machine and I won't know a thing about it. Or if I'm if it's run on my main machine, the thing I'm looking at right now, I might see a notification at the top right of the the page to tell me that a schedule has run. But there's something quite nice. If they can notify if the Claude app can notify me on my phone and then I can jump in and start messaging it and say give me article one one three, that's what that's the sweet spot. The Claude is trained to avoid. This is interesting. Engaging in stock and trading or investment transactions, inputting sensitive data, and gathering or scraping facial images. Which is interesting cuz it needs to see that it's a facial image or it needs to see that it's a stock trading platform before it's going to choose not to engage with it. So yeah, you've you've you've already sent all your sensitive stuff to Claude and before it's even decided what it's not going to do it. What to avoid. Managing financial accounts or investments, handling legal documents or contracts, processing medical or health information, interacting with apps containing personal information. I think this goes without saying. However, one of the most boring laborious tasks that I have to do on a weekly basis is to go through all my emails, download invoices, and then link them to transactions in my accountancy app, which I found out today Kobaza doesn't have What you do is just this fragmented system across many platforms. But you still have to put receipts next to purchases, right? There is an app that you do that, and that's just such a boring task for me. It's not like I have tons of but it's just it it it gets to a point where I've got like tens of them to go through. I'm just like an assistant to do that. Like I have an actual assistant, a teammate. She goes through all my accounts, downloads everything, and if she doesn't have an access to an account uh like there are a few that I uh I have access like Amazon, AWS, and stuff like that. She asks me to get to give her the invoice, and it's so annoying. So you go to settings, command comma, and it's down here under desktop general desktop app. And then this should be enable you to click. It was a weird one. I didn't I had Oh, sorry. Sorry. I I I I showed you exactly what was happening. You use and computers. Nothing Nothing was down here, and I selected browser use and whatever, and I was like, "Where's this computer use everyone's seeing?" But I just made sure I updated and restarted, and then computer use is here, and you turn it on and grant access, and then you can even deny certain apps. So yeah, get started. This is part of a larger conversation on my show Command AI, which we stream live every single week. We discuss the news and all things related to AI in the world of design and web. Catch us next week and join in the banter. Command AI