DEV Community

Cover image for ๐—ฉ๐—ผ๐—ถ๐—ฐ๐—ฒ ๐—”๐—œ: ๐—ก๐—Ÿ๐—จ (๐—ก๐—ฎ๐˜๐˜‚๐—ฟ๐—ฎ๐—น ๐—Ÿ๐—ฎ๐—ป๐—ด๐˜‚๐—ฎ๐—ด๐—ฒ ๐—จ๐—ป๐—ฑ๐—ฒ๐—ฟ๐˜€๐˜๐—ฎ๐—ป๐—ฑ๐—ถ๐—ป๐—ด) - ๐—จ๐—ป๐—ฑ๐—ฒ๐—ฟ๐˜€๐˜๐—ฎ๐—ป๐—ฑ๐—ถ๐—ป๐—ด ๐—ช๐—ต๐—ฎ๐˜ ๐—ฌ๐—ผ๐˜‚ ๐—”๐—ฐ๐˜๐˜‚๐—ฎ๐—น๐—น๐˜† ๐— ๐—ฒ๐—ฎ๐—ป๐˜
WanjohiChristopher
WanjohiChristopher

Posted on

๐—ฉ๐—ผ๐—ถ๐—ฐ๐—ฒ ๐—”๐—œ: ๐—ก๐—Ÿ๐—จ (๐—ก๐—ฎ๐˜๐˜‚๐—ฟ๐—ฎ๐—น ๐—Ÿ๐—ฎ๐—ป๐—ด๐˜‚๐—ฎ๐—ด๐—ฒ ๐—จ๐—ป๐—ฑ๐—ฒ๐—ฟ๐˜€๐˜๐—ฎ๐—ป๐—ฑ๐—ถ๐—ป๐—ด) - ๐—จ๐—ป๐—ฑ๐—ฒ๐—ฟ๐˜€๐˜๐—ฎ๐—ป๐—ฑ๐—ถ๐—ป๐—ด ๐—ช๐—ต๐—ฎ๐˜ ๐—ฌ๐—ผ๐˜‚ ๐—”๐—ฐ๐˜๐˜‚๐—ฎ๐—น๐—น๐˜† ๐— ๐—ฒ๐—ฎ๐—ป๐˜

What happens after the text arrives from ASR.

๐Ÿ—ฃ๏ธ Say you tell a voice assistant:
"Book me a flight to Paris next Friday"

ASR does its job and converts that into text.

But at this point, the system still doesnโ€™t really understand anything.
It doesnโ€™t know:
๐Ÿ”นwhat youโ€™re trying to do.
๐Ÿ”นwhich parts of the sentence matter.
๐Ÿ”นor what information is missing.

Thatโ€™s where NLU (Natural Language Understanding) comes in.

NLU
Hereโ€™s what NLU figures out behind the scenes:

1๏ธโƒฃ - ๐—œ๐—ป๐˜๐—ฒ๐—ป๐˜ ๐—–๐—น๐—ฎ๐˜€๐˜€๐—ถ๐—ณ๐—ถ๐—ฐ๐—ฎ๐˜๐—ถ๐—ผ๐—ป
What are you trying to do?
โ†’ You want to book a flight.

2๏ธโƒฃ - ๐—˜๐—ป๐˜๐—ถ๐˜๐˜† ๐—˜๐˜…๐˜๐—ฟ๐—ฎ๐—ฐ๐˜๐—ถ๐—ผ๐—ป- details (entities)
โ†’ destination: Paris
โ†’ date: next Friday

3๏ธโƒฃ And finally - ๐—ฆ๐—น๐—ผ๐˜ ๐—™๐—ถ๐—น๐—น๐—ถ๐—ป๐—ด - whatโ€™s missing
โ†’ where are you flying from?

So the system knows it needs to ask a follow-up.

That's the moment where the conversation starts to feel natural instead of scripted.

With models like GPT-4 or Claude, etc, a lot of this NLU work can now happen in one step without training separate intent classifiers or entity models. The model reasons about intent, details, and gaps together.

Thatโ€™s a big reason modern Voice AI agents feel more flexible than the older "say it exactly this way" systems.

Top comments (0)