Natural language understanding tough for neural networks

LEIAs process natural language through six stages, going from determining the role of words in sentences to semantic analysis and finally situational reasoning. These stages make it possible for the LEIA to resolve conflicts between different meanings of words and phrases and to integrate the sentence into the broader context of the environment the agent is working in. For the most part, machine learning systems sidestep the problem of dealing with the meaning of words by narrowing down the task or enlarging the training dataset. But even if a large neural network manages to maintain coherence in a fairly long stretch of text, under the hood, it still doesn’t understand the meaning of the words it produces.

Some scientists believe that continuing down the path of scaling neural networks will eventually solve the problems machine learning faces. But they fell from grace because they required too much human effort to engineer features, create lexical structures and ontologies, and develop the software systems that brought all these pieces together. Researchers perceived the manual effort of knowledge engineering as a bottleneck and sought other ways to deal with language processing. Gilbert says that AT&T is also trying to cut down obstacles by offering its new cloud-based enabler platform that will have speech capabilities and can be used to more rapidly create natural language customer care and sales applications for contact centers.

What’s the difference in Natural Language Processing, Natural Language Understanding & Large Language Models?

Humans further develop models of each other’s thinking and use those models to make assumptions and omit details in language. We expect any intelligent agent that interacts with us in our own language to have similar capabilities. LEIAs assign confidence levels to their interpretations of language utterances and know where their skills and knowledge meet their limits. In such cases, they interact with their human counterparts (or intelligent agents in their environment and other available resources) to resolve ambiguities.

What Are The Similarities & Differences Between NLU, NLG & NLP?

Mobile and cloud are expected to continue to drive interest and lower cost, hopefully allowing more companies to board the NLU train. “The more categories you have, the more different kind of users you have, the harder it is to categorize what they’re saying,” says Deborah Dahl, principal of Conversational Technologies, and chair of the World Wide Web Consortium Multimodal Interaction Working Group. “If you have something like an airline, where most of the callers are used to the system and have a clear idea of what they want, the system’s going to work better because what the caller will say is more precise.” “Some systems may not fully automate because it could be part of the design, or it could be that the complexity of the request is hard and it’s best to send them to a specialized agent,” Gilbert says.

“We take large data and train automated systems to learn from the data,” says assistant vice president Mazin Gilbert, of AT&&T Intelligent Systems Research. “Our algorithms in the AT&T WATSON engine allow us to learn from the variability in data; people speak about the same issue, the same intent, in thousands of different ways. Also, these algorithms have to be robust to accents, dialects, background noise, and devices that are used.” “A system that constantly asks for confirmations creates a disjointed conversation that callers tend to reject,” she says. “However, systems that can handle corrections and verifications by dynamically embedding the confirmations in the next prompt are more engaging, leading to better automation rates.”

Many experts say that the technology is too expensive and has a long way to go, while others point to a spate of products mature enough to operate as money makers. Explore the future of AI on August 5 in San Francisco—join Block, GSK, and SAP at Autonomous Workforces to discover how enterprises are scaling multi-agent systems with real-world results. Join leaders from Block, GSK, and SAP for an exclusive look at how autonomous agents are reshaping enterprise workflows – from real-time decision-making to end-to-end automation. “We’ve been working on going from very unique, very expensive applications,” he says. “We’ve been trying to move to the next level in how you scale this business. There are many new drivers that weren’t there ten or fifteen years ago. “The reason NLU is expensive to implement today is because you either have to pay one of very few companies to use their technology, or you have to invest in a lot of research science,” Microsoft’s Bukshteyn says.

Machine learning does not compute meaning

After implementing AT&T’s NLU solutions, by 2010, Panasonic was able to resolve a million more customer problems a year, with 1.6 million fewer calls than in 2005. The core technology for understanding natural responses to open questions (such as “How may I help you today?”) is called SpeakFreely. Its technology involves taking a collection of responses to the open question, analyzing each to attribute a meaning, and then defining an appropriate application response. An IVR can respond to unique requests that have not previously been encountered by using SpeakFreely for NLU. Once the intent and information is extracted, based on AT&T’s dialogue technology and how the system is designed, a company can send callers to a specialized agent or complete the automation.

• Natural language understanding is meant to attack a basic problem of call centers—extended call times—by automatically handling calls, and reap significant savings too.
• We give you the inside scoop on what companies are doing with generative AI, from regulatory shifts to practical deployments, so you can share insights for maximum ROI.
• In the real world, humans tap into their rich sensory experience to fill the gaps in language utterances (for example, when someone tells you, “Look over there?” they assume that you can see where their finger is pointing).
• The NLU engine is more like a neural network that understands true intent and meaning, and it can understand meaning from natural words and phrases.

You can change your mind about an original request or even interrupt yourself mid-sentence, and you can use unusual words or phrases. The NLU engine is more like a neural network that understands true intent and meaning, and it can understand meaning from natural words and phrases. One of the key features of LEIA is the integration of knowledge bases, reasoning modules, and sensory input.

Adapting your GTM plans to market disruption

Nuance technology has over 125 NLU solutions in 17 languages packaged into a guided graphical interface so that their customers can deploy their NLU solution. This means that improved caller satisfaction, increased automation, and reduced agent misroute rates are now available with reasonable ROI to enterprises outside the Fortune 500, the company says. Knowledge-lean systems have gained popularity mainly because of vast compute resources and large datasets being available to train machine learning systems. With public databases such as Wikipedia, scientists have been able to gather huge datasets and train their machine learning models for various tasks such as translation, text generation, and question answering. In one case, customer experience management solutions provider SpeechCycle worked with a national broadband service provider that used a legacy touch-tone IVR application to handle 40 to 60 million calls per year.

Smart Customer Journeys with AI and Technology

Machine learning models are knowledge-lean systems that try to deal with the context problem through statistical relations. During training, machine learning models process large corpora of text and tune their parameters based on how words appear next to each other. In these models, context is determined by the statistical relations between word sequences, not the meaning behind the words.

The AI insights you need to lead

The complex menu system often took customers up to a minute to navigate, and a misroute rate of 25 percent was estimated to cost the company millions of dollars in agent retransfers. One of Nuance’s long-time customers, Amtrak, uses an IVR deployment that contains SpeakFreely and Call Steering that helps “Julie,” the company’s automated customer service representative. Julie handles about 20 million callers a year, and roughly 50,000 calls a day, though during peak travel times, she may handle as many as 95,000 callers a day. She is able to recognize 45,000 cities, up from 1,000 from when she was first launched. She completely handles an average of 25 percent of all calls placed to the 800 number, or approximately five million calls a year.