---
title: "The implications of OpenAI's speech model gpt-realtime"
description: "OpenAI has launched its new speech-to-speech model, gpt-realtime, enhancing natural speech and reasoning capabilities. The model supports new API features, including Model Context Protocol (MCP) and i"
type: "news"
locale: "en"
url: "https://longbridge.com/en/news/255680309.md"
published_at: "2025-09-02T22:04:56.000Z"
---

# The implications of OpenAI's speech model gpt-realtime

> OpenAI has launched its new speech-to-speech model, gpt-realtime, enhancing natural speech and reasoning capabilities. The model supports new API features, including Model Context Protocol (MCP) and image input, making it suitable for real-time applications like customer support and education. Analysts note its potential for improved human expressiveness but highlight challenges such as latency issues and regulatory scrutiny over voice impersonation. The model is priced at $32 per million tokens for input and $64 for output, with safeguards to prevent misuse.

OpenAI's new speech-to-speech model, designed for more natural speech and reasoning, shows the continual evolution in speech-to-speech technology and the increasing ways AI voice is becoming more indistinguishable from human voice.

On Aug. 28, the AI vendor introduced gpt-realtime and new API capabilities, including Model Context Protocol (MCP) server support, image input and phone calling through the Session Initiation Protocol (SIP). SIP is a protocol for initiating, managing and terminating multimedia communication sessions like voice and video calling, instant messaging and gaming over IP networks.

OpenAI said the new speech-to-speech gpt-realtime is good at interpreting system messages and developer prompts. This means the model can read disclaimer scripts word-for-word on a support call, switch between languages midsentence or repeat alphanumeric passages back to the user. OpenAI also released two new voices, Cedar and Marin, which are available in Realtime API.

Image inputs in gpt-realtime also allow users to add images, photos, screenshots and audio or text to Realtime API. OpenAI introduced Realtime API last October and it is now generally available, along with the new speech model.

## Some benefits

The model is best for applications where natural-sounding voice agents will thrive.

"Gpt-realtime unifies speech recognition, reasoning and speech generation in a single model, eliminating the latency of multimodel pipelines," said Arun Chandrasekaran, an analyst at Gartner. "This makes it suited for real-time, voice-first applications where fluidity and speed are critical."

He added that customer support and contact centers will benefit from the expressive multilingual voices. Moreover, the education and healthcare sectors can use them for tutoring or patient engagement.

Chandrasekaran said the new voices are also beneficial for human expressiveness.

"It follows instructions faithfully, with the promise of smoother emotional inflection," he said.

The new model is a nice evolution from a UX perspective, said David Nicholson, an analyst at The Futurum Group.

"Some new voices sound more natural, \[which\] will delight some and freak others out," he said. "It is still not the most natural, but the most streamlined 'back end' now."

He added that developers previously needed separate models for automatic speech recognition, language understanding and text-to-speech.

"The unified speech-to-speech pipeline simplifies integration," Nicholson said. "That's important for developers who will like the simplified workflow."

## Some challenges

The new model, however, comes with some challenges.

For one, Nicholson said that his tests on 5G and home Wi-Fi show that the model is "still not perfectly real time."

> Right now, we at least have indications that we are talking to AI at times.
> 
> **David Nicholson**Analyst, The Futurum Group

He added that the delay will improve over time and might even alleviate the eeriness of how real AI speech is getting.

"Right now, we at least have indications that we are talking to AI at times," he said. "Once latency is reduced enough, things get scary."

The scariness comes from the fact that people will have difficulty distinguishing between an AI conversation and a human conversation.

Many consumers already have a tough time distinguishing between what is AI and what is not AI.

"Regulatory scrutiny around voice impersonation is a major looming challenge," Chandrasekaran said.

According to OpenAI, Realtime API has safeguards that help prevent misuse. Developers can also add their own safety guardrails with the Agents SDK.

Chandrasekaran added that another challenge with the speech-to-speech model is the 32k context window. He said that compared with rivals, it is small and limits long-form applications or applications that rely heavily on memory.

"The 32k limit supports extended conversations and multimodal tasks but restricts very long dialogues or enterprise document processing," he said.

The gpt-realtime model costs $32 per 1 million token input and $64 per 1 million token output. OpenAI also revealed that MCP support is now available in Realtime API.

*Esther Shittu is an Informa TechTarget news writer and podcast host covering artificial intelligence software and systems.*

### Related Stocks

- [OpenAI.NA - OpenAI](https://longbridge.com/en/quote/OpenAI.NA.md)

## Related News & Research

| Title | Description | URL |
|-------|-------------|-----|
| 一切向 “钱” 看！ChatGPT 正式开测广告，网上骂声一片 | OpenAI 开始对免费与低价订阅用户测试广告功能，以缓解高昂运营成本。此举引发用户强烈反对，被批损害体验与信任。竞争对手 Anthropic 借机讽刺，OpenAI CEO 则激烈回击。此举背后是为支撑其千亿美元级融资谈判，向资本市场证明 | [Link](https://longbridge.com/en/news/275435957.md) |
| OpenAI 计划本周在 ChatGPT 中推出新的模型，ChatGPT 月增长超过 10% | OpenAI 计划本周在 ChatGPT 中推出新的模型，ChatGPT 月增长超过 10%。风险提示及免责条款 市场有风险，投资需谨慎。本文不构成个人投资建议，也未考虑到个别用户特殊的投资目标、财务状况或需要。用户应考虑本文中的任何意见、 | [Link](https://longbridge.com/en/news/275322620.md) |
| “OpenAI 链” 强劲反弹 | OpenAI 的 ChatGPT 月增长率已恢复到 10% 以上，计划本周推出新模型，推动复苏。Similarweb 报告显示，ChatGPT 在 2026 年首月实现应用下载量和月活跃用户数的增长，Codex 使用量增长约 50%。同时， | [Link](https://longbridge.com/en/news/275376241.md) |
| 因 “太像人” 而被迫消失？OpenAI 为何永久关停 GPT-4o | OpenAI 宣布将于 2 月 13 日永久关停 GPT-4o 模型。该模型因高度拟人化和过度迎合特质，导致用户产生严重情感依赖，甚至引发自杀及心理危机等多起法律诉讼。尽管部分用户强烈抗议，公司仍决定以安全为由强制下线，转推更具防护性的替代 | [Link](https://longbridge.com/en/news/275419737.md) |
| 从税务会计到支付设施：OpenAI 正在为 ChatGPT 购物功能的底层琐事 “头秃” | 随着 ChatGPT 试图扩展购物功能并引入大品牌，公司可能被迫承担更多的交易处理工作，从而触发复杂的税务合规义务。如果 OpenAI 未来建立起庞大的购物业务，极有可能成为美国各州税务审计的目标。在支付基础设施方面，OpenAI 近期选择 | [Link](https://longbridge.com/en/news/275568414.md) |

---

> **Disclaimer**: This article is for reference only and does not constitute any investment advice.
