A Dream for Bot Farms? Claude AI Now Capable of PC Control and Mouse Maneuvering

Anthropic, a developer of artificial intelligence technology, has recently launched an experimental public beta version of an API for Claude AI, named "Computer Usage." This API enables Claude to control a computer and complete tasks by moving the mouse.

In essence, you can issue a set of commands to Claude AI, which will then control the computer, click with the mouse, and input data with the keyboard to accomplish specific tasks.

This functionality has practical implications across various scenarios:

• Developers can utilize this feature for software testing.
• Researchers can automate data collection.
• Office workers can process data in bulk.
• It could even be used by bot farms for mass posting content.

Anthropic stated in a blog post:

"We're experimenting with some new functionalities for computer usage. We haven't created specific tools for Claude to complete individual tasks. Instead, we've taught it general computer skills, allowing it to use a variety of standard tools and software programs designed for humans."

Developers can also integrate this API to translate specific commands into computer instructions. For example, "Use my computer and online data to fill out this form: check the form, move the cursor to open a browser, open a webpage, and use the data from this webpage to fill out the form."

However, there are currently some limitations to Claude's computer-using capabilities, such as the inability to perform common operations like scrolling, dragging, and zooming. Moreover, this API might be detected as an attack by security software, which could affect its usability.

Of particular concern, as mentioned in the title, are ill-intentioned uses like those by bot farms. Anthropic has developed new classifiers to detect and identify purposes such as sending spam, mass producing and posting false information, phishing, or fraud. When such activities are detected, the tasks will be terminated.