WTF Is Going On(Weights, Tools & Frameworks)

English
Mistral AI 보도

Voxtral 3

원문 읽기 — Mistral AI →

“Voxtral 3: Mistral's voice agent SDK for real-time speech in 50+ languages — accurate transcription, emotional TTS, deep tool use. EU-hosted or self-deployed.”

어떤 얘기가 오갔나

587포인트 · 149댓글
Closed model unfortunately, continues the theme of TTS / STT being really not great for local deployments.
> Human-like intelligence at your (spoken) command. The new voice agent SDK combines listening, reasoning, tool calling, and speaking into a real-time experience. Agents can retrieve information, interact with business systems, and complet…
I've transcribed calls with Microsoft Teams and 8x8 and the transcripts are absolutely awful. Sometimes so poor that one cannot reliably use them with LLMs. I feel so incredibly left out when I see these models on HN and have to go back to…
Very unrealistic demo. It is impossible to get a dermatologist appointment that fast in France
Considering the progress on speech recognition, why do YouTube subtitles have little in common with what's spoken in the video? Shouldn't Google be able to do a good job at auch a task?
Quite funny that the agent starts speaking with a French accent after reading French :D
Slightly off-topic, but can anybody recommend a local model/tool that fixes timestamps of existing srt subtitles? That should be easier than generating them from scratch. When I last looked for this a few years ago, I only found a really p…
Has mistral just stopped doing open source? I feel like I haven't seen an open model from them in a while, and not many people are talking about this. If it was an american company, or a chinese company, i feel like it'd be every comment.
Their previous generation open weight STT model was pretty good. I have recently launched commercial Windows software implementing offline inference of Voxtral Mini 4B Realtime on commodity hardware: https://vrmac-softver.com/speech2text I…
I know the doomerism of robots takin R jobs get repetitive, but this seems like it would work very well in call centers. I get frustrated talking to AI call center agents, but that's often because they are less capable and prone to bad log…
No one seems to solve the problem when you speak some other language than English but need to mix in English words and speech-to-text that. Because of these words the output is always garbage
I've been building voice agents for the past year, and honestly the word error rate and how good they sound are "good enough" across countless providers. The real gaps are in latency, handling interruptions, interrupting the speaker if nee…

상황판의 다른 소식