It was only a couple of days ago that Anthropic announced new models and computer use. You can now control computers with AI. While it is in beta, plenty of AI enthusiasts are exploring ways to do more with it. Mckay Wrigley seems to have come up with a way to use claude to control an iPhone by mirroring it on a Mac.
Anthropic computer use API + iPhone mirroring to a Mac = AI controlled phone.
Watch Claude control my phone and successfully look up stats in my Sports app.
I even got it to play a game in the Chess app against another AI – pretty crazy.
And this is the worst it’ll ever be. pic.twitter.com/35mh7T6PPs
— Mckay Wrigley (@mckaywrigley) October 23, 2024
As he explains, Claude controlled the phone and looked up stats in a sports app. Considering how much it costs to use computer use for a basic task, one has to wonder how much this costs. Speaking of Anthropic, the company has announced that Claude can now write and run code. You can now use it for serious data analysis.
Claude can now write and run code.
We’ve added a new analysis tool. The tool helps Claude respond with mathematically precise and reproducible answers. You can then create interactive data visualizations with Artifacts.
Enable the feature preview: https://t.co/bJ8BjBT6zG. pic.twitter.com/Jq5xOHBmiR
— Anthropic (@AnthropicAI) October 24, 2024