Voice AI: Build or buy? How to choose the right solution for your contact center Learn more

Play Podcast

The future of conversational AI (Part 2)

Summary

PolyAI’s Michelle (SVP Marketing), Nikola (CEO), and Yan (COO) discuss the challenges of enterprises building upon LLMs and the importance of explainability, accountability, and safety in all aspects of AI deployment. Also, is hybrid the way in the short term?

Takeaways

Enterprises feel pressured to adopt generative AI due to fear of missing out (FOMO), but they often lack clarity on how to effectively implement or benefit from it.

Many think that simply using tools like GPT-4 counts as having their own LLM, when in reality, training an LLM from scratch with proprietary data is a complex and resource-intensive task.

A blended approach that combines traditional AI with generative models is likely to be the future of conversational AI. This approach balances transactional accuracy with the flexibility and creativity of generative AI.

MIchelle Schroeder

SVP Marketing, PolyAI

Nikola Mrkšić

CEO & Co-founder, PolyAI

Yan Zhang

COO, PolyAI

Never miss an episode.

 


Episode highlights

Very few companies have what would be considered a proper large language model with a dataset that is theirs and useful in the right way it’s a lot of work – OpenAI didn’t build it overnight

I think a lot of people think they have to have it. It’s come from the top. It’s you know, like a first order priority or close to it. So, it’s almost difficult to talk about it without like asking what have you really done? Yeah. And I think maybe to clarify, people mean different things when they say they’re building their own LLM, right?

"Very few companies have what would be considered a proper large language model with a dataset that is theirs and useful in the right way it's a lot of work - OpenAI didn't build it overnight."

I just had a meeting with a prospect yesterday. The upper echelons of management believe that they need to train their own LLM that’s going to encompass all of their internal knowledge, customer information, policies, etc. I think that the type of organizational action that’s triggered when FOMO—the fear of missing out—is the trigger is quite different than when you actually have an active problem to solve.

I think people are actually in this mode of accumulating assets. It’s oh, I want my own LLM so that I’m not missing out. But they’re not really thinking about what problems they actually want to solve with it. It’s a fairly interesting part of the adoption curve.

"I think people are actually in this mode of accumulating assets. It's oh, I want my own LLM so that I'm not missing out. But they're not really thinking about what problems they actually want to solve with it. It's a fairly interesting part of the adoption curve."