Global Technology Leader saves 50 % processing cost with Next Gen support automation powered by LLM

Using Intent Feedback Loop Automation, Multi-turn conversation coherence, and NLG-based on-demand conversational analytics

Objectives

  • To transform customer experience using LLM-based hyper-automation solutions
  • The current conversational AI solution deployed is trained on limited intents and phrases and is unable to map 50% of the conversations
  • A lot of manual effort goes into extracting missed utterances from the bot and mapping them with the right intent to re-train the bot
  • Key business insights difficult to retrieve from current dashboard

Challenges

  • Distributed / unstructured data environment
  • Data accuracy and performance is of high importance
  • Integrated customer internal enterprise applications
  • 200+ complex conversational multilingual bots

Solutions

Automate feedback loop with the help of LLMs and existing data science models for classification of missed utterances. Summarization of Dashboards/Charts powered by Generative AI (NLG). Adding Generative AI features to the existing conversational bots

Google-Anomaly-Assets-img03

Embedding Large Language Model – Classification logic within LLM using embedded data, entities, and utterances to calculate a mapping score gets calculated.

Google-Anomaly-Assets-img04
ML Model – Created based on LLM data and once trained saved in the client’s cloud for further reference.
Google-Anomaly-Assets-img05
Python Notebook – ML and embedding logic will be executed in python notebooks in a scheduled manner.
Google-Anomaly-Assets-img06

BOT Training API – Re-training of the bot with new classified data (intent-utterances mapping).

Google-Anomaly-Assets-img07

On-demand dashboard framework created to track metrics as sentiment analysis, context management metrics, AI recommendation for new workflows

Google-Anomaly-Assets-img08

Using NLG to generate summary of the dashboard which will help in drawing required business insights customised to stakeholder persona

Google-Anomaly-Assets-img09

Added Generative AI inbuilt features to the current bots : Generators, Generative fallback, and answer feedback

Circle-01

Outcome

~90% Automation achieved for conversations
Improve End customer experience enabling contextual conversation with 94% confidence score
Custom business insights summary as per stakeholders using generative conversational analytics

Integration with Enterprise Application to automation feedback loop

Agile Methodology for acceleration of development
Proprietary Technology for quick adoption of customer environment to deliver in secured environment
Self Service Ability across all enterprise layers
Tech Stack

Python, Workflows, Vertex AI, Dialog Flow, LLM, BigQuery, Looker, LookML

DevOps Engineer

Industry experience: 10 Years
Location: Pune

To apply for this opportunity, write to us at careers@agivant.com with the following subject: AG5111-DevOps Engineer

Agivant is a new-age AI-First Digital and Cloud Engineering services company that drives Agility and Relevance for our client's success.

Powered by cutting-edge technology solutions that enable new business models and revenue streams, we help our customers achieve their trajectory of growth.

Agility is a core muscle, an integral part of the fabric of a modern enterprise.

To succeed in an ever-changing business environment, every modern organization needs to adapt and renew itself quickly. We help foster a more agile approach to business to reconfigure strategy, structure, and processes to achieve more growth and drive greater efficiencies.

Relevance is timeless, and is the only way to survive, and to thrive.

The quest for relevance defines the exponential acceleration of humanity. This has presented us with a slew of opportunities, but also many unprecedented challenges. With technology-led innovation, we help our customers harness these opportunities and address the myriad challenges.