Generative AI is a groundbreaking technology that was almost impossible to ignore in 2023. While researchers have been finding novel ways to harness generative AI and large language models (LLMs) for robotics, there haven’t been many companies that have been able to commercialize a system combining generative AI and robotics.

This is where Sereact stands out. Last year, it released PickGPT, a robotics transformer that combines LLMs with the company’s computer vision technology. The technology allows robot operators to instruct robots using natural language. By leveraging generative AI, PickGPT enables robots to process natural language and visual information and correlate multimodal data.

PickGPT is a software-based robotics system that doesn’t require programming or training, claimed Sereact. Every day, more robots are deployed in more places, but the number of roboticists and programmers isn’t growing at the same rate. This means robots need to be intuitive enough that those without specialized skills can work with them.

PickGPT reduces the time needed to set up and customize robots, allowing employees to focus on other essential tasks. PickGPT also offers more flexibility and quality control. With the robotics transformer, robots can respond quickly and easily to new tasks or changing environmental conditions, which are common in warehouse settings.

PickGPT can also recognize and identify objects and products in real-time based on their visual characteristics. These characteristics can include product titles, descriptions, as well as visual cues. The transformer automatically analyzes product images and matches them with items in any real-world scenario. PickGPT uses groundbreaking technology to make robots smarter and easier to use.

Explore the RBR50 Robotics Innovation Awards 2024.