OpenAI might debut a multimodal AI digital assistant quickly

OpenAI has been exhibiting a few of its prospects a brand new multimodal AI mannequin that may each speak to you and acknowledge objects, in line with a new report from The Data. Citing unnamed sources who’ve seen it, the outlet says this could possibly be a part of what the corporate plans to indicate on Monday.

The brand new mannequin reportedly presents quicker, extra correct interpretation of photographs and audio than what its present separate transcription and text-to-speech fashions can do. It might apparently be capable of assist customer support brokers “higher perceive the intonation of callers’ voices or whether or not they’re being sarcastic,” and “theoretically,” the mannequin may help college students with math or translate real-world indicators, writes The Data.

The outlet’s sources say the mannequin can outdo GPT-4 Turbo at “answering some sorts of questions,” however remains to be inclined to confidently getting issues unsuitable.

It’s attainable OpenAI can be readying a brand new built-in ChatGPT capacity to make cellphone calls, in line with Developer Ananay Arora, who posted the above screenshot of call-related code. Arora additionally noticed proof that OpenAI had provisioned servers meant for real-time audio and video communication.

None of this is able to be GPT-5, if it’s being unveiled subsequent week. CEO Sam Altman has explicitly denied that its upcoming announcement has something to do with the mannequin that’s imagined to be “materially higher” than GPT-4. The Data writes GPT-5 could also be publicly launched by the tip of the 12 months.