EN
OpenAI's ChatGPT Operator is an innovative AI agent designed to function as a personal assistant, capable of completing various tasks such as ordering coffee, purchasing a house, or even building and deploying applications. Recently, OpenAI released an open preview for this AI agent, which actively interacts with the digital world to perform tasks on behalf of users.
The ChatGPT Operator, also known as a Computer Using Agent (CUA), is built on top of ChatGPT-4 and incorporates advanced vision capabilities. This model is specifically trained to interact with web elements, including buttons, menus, and forms, allowing it to navigate websites seamlessly. The CUA operates by processing raw pixels on the screen and simulating mouse and keyboard actions within a virtual environment.
The functionality of the Operator involves a three-step process: perception, reasoning, and action. First, it captures a screenshot of the current display. Next, it employs a Chain of Thought reasoning method to determine the necessary actions. Finally, it executes the required tasks, such as clicking, scrolling, or typing, to achieve the desired outcome.
To access the ChatGPT Operator, users must meet two requirements: being located in the United States and having a pro subscription to ChatGPT, which costs $200. For those outside the U.S., using a VPN can help bypass geographical restrictions. Users can access the Operator through the designated website, where they can input prompts and explore its capabilities.
One practical application of the Operator is publishing a blog on a Wix Studio website. The agent initiates the process by opening a browser interface that resembles Google Chrome. It navigates to the Wix Studio login page, prompting the user to enter their credentials. Once logged in, the Operator efficiently locates the draft blog and confirms the user's intent to publish it before executing the action.
The Operator can also perform direct updates on websites, particularly those built on no-code platforms. For instance, when tasked with modifying the navigation menu, the agent encounters a security prompt due to the potential risks associated with live website changes. After confirming the action, it successfully navigates to the menu management section and removes the specified item.
While the Operator demonstrates impressive capabilities, it does have limitations. For example, when attempting to change the font weight of a menu, the agent struggled with the nuances of styling adjustments. Additionally, when tasked with finding a suitable GitHub library for converting Markdown text for a React project, it often selected the first relevant item without considering other options, highlighting the need for more specific prompts.
As users continue to explore the capabilities of the ChatGPT Operator, there are numerous potential applications, from finding the best insurance rates to structuring research papers or even shopping for clothing. Ongoing testing will reveal the full extent of what this AI agent can accomplish, providing valuable insights for developers and users alike.
Q: What is OpenAI's ChatGPT Operator?
A: OpenAI's ChatGPT Operator is an innovative AI agent designed to function as a personal assistant, capable of completing various tasks such as ordering coffee, purchasing a house, or building and deploying applications.
Q: How does the ChatGPT Operator work?
A: The Operator works through a three-step process: perception (capturing a screenshot), reasoning (determining necessary actions), and action (executing tasks like clicking or typing).
Q: What technology is the ChatGPT Operator built on?
A: The ChatGPT Operator is built on top of ChatGPT-4 and incorporates advanced vision capabilities, allowing it to interact with web elements like buttons and forms.
Q: What are the requirements to access the ChatGPT Operator?
A: Users must be located in the United States and have a pro subscription to ChatGPT, which costs $200. Users outside the U.S. can use a VPN to bypass geographical restrictions.
Q: Can the Operator publish a blog?
A: Yes, the Operator can publish a blog on a Wix Studio website by navigating to the login page, entering credentials, locating the draft blog, and confirming the intent to publish.
Q: What limitations does the ChatGPT Operator have?
A: The Operator has limitations, such as struggling with nuanced styling adjustments and often selecting the first relevant item when searching for resources, indicating a need for more specific prompts.
Q: What are some potential applications of the ChatGPT Operator?
A: Potential applications include finding the best insurance rates, structuring research papers, and shopping for clothing, with ongoing testing revealing more capabilities.
Q: How does the Operator navigate websites?
A: The Operator navigates websites by processing raw pixels on the screen and simulating mouse and keyboard actions within a virtual environment.