Contact Us

If you still have questions or prefer to get help directly from an agent, please submit a request.
We’ll get back to you as soon as possible.

Please fill out the contact form below and we will reply as soon as possible.

  • Go to Haptik Website
  • Contact Us
  • Home
  • Smart Agent Chat
  • Analytics

Analyse Agent & Team Performance

Written by Medha Anand

Updated on April 8th, 2024

Contact Us

If you still have questions or prefer to get help directly from an agent, please submit a request.
We’ll get back to you as soon as possible.

Please fill out the contact form below and we will reply as soon as possible.

  • Getting Started
    Build Deploy Analyse Manage Account Bot Deactivation
  • Bot Building
    Essentials Smart Skills Steps User Messages Bot Responses Entities Connections Customisations User feedback collection Testing Whatsapp Bots NLU Bot Maintenance
  • Smart Agent Chat
    Set up Admin Settings MyChats Section (Agent Inbox) Live Traffic Section Teams Section Archives Section Analytics Plans on Smart Agent Chat
  • Conversation Design
    Design Basics Design Guides Designing for Platforms Designing WhatsApp Bots
  • Developer Guides
    Code Step Integration Static Step Integration Shopify Integration SETU Integration Exotel Integration CIBIL integration Freshdesk KMS Integration PayU Integration Zendesk Guide Integration Twilio Integration Razorpay Integration LeadSquared Integration USU(Unymira) Integration Helo(VivaConnect) Integration Salesforce KMS Integration Stripe Integration PayPal Integration CleverTap Integration Fynd Integration HubSpot Integration Magento Integration WooCommerce Integration Microsoft Dynamics 365 Integration
  • Deployment
    Web SDK WhatsApp Facebook Instagram Sunshine Conversation LINE Google Business Messages Telegram MS Teams Bot as an API iOS SDK Android SDK
  • External Agent Tool Setup
    Zendesk Chat Salesforce Service Cloud Freshchat Zoho NICE CXOne Gorgias
  • Analytics & Reporting
    Intelligent Analytics
  • Notifications
    SMS Notifications Success Measurement
  • Commerce Plus
    Catalog Integration Bot Building Guide Channel Deployments Unified ML Pipeline Documentation
  • Troubleshooting Guides
    Error Messages FAQs
  • Release Notes
+ More

Table of Contents

How to Analyse performance metrics? Overview Time Stats Chat Stats Info Agent Statistics How to analyse Team Data Reports Tips to Manage a Team

How to Analyse performance metrics?

There are two ways to analyse performance metrics:

  • View Team level performance metrics
  • View Agent level performance metrics

You can filter the summary and agent metrics by Custom time or Custom date. Refer to the image below for how to check hourly or daily Analytics for a specific Team.

Tip: You can choose hourly slots on a date in the Time picker to get the metric values for the chosen Date and Time.

This tab has the following features or options to exercise and analyze.

Overview

  • Avg. User rating
    Average rating of all chats where the end-user submitted feedback.

  • Total Number of agents
    The value here gives us the number of agents, who received at least a single chat in the Team. Only those agents who received any chat(s) are counted.

  • Time saved of agents
    All chats where an Haptik bot (gogo) took part, we add up the individual resolution time for all such chats, that would be the total amount of time, Haptik bot (gogo) was responding to the end-user, instead of a human agent.

Time Stats


  • Average Agent First Response Time (FRT)
    Average agent first response time is the average of first response times taken by the agent to send the first response to end-users after a chat was assigned to the agent. Only the chats which were initiated by users during the selected time range will be taken into account.

    Note: This metric does not include Queue Time for the chats.

  • Average Queue Time (AQT)
    AQT is the average total amount of time, chats have stayed within a queue. Chats remain in the queue for the below-mentioned reasons
    • A fresh chat has been initiated for a team, and there are no free agent slots available.
    • A chat has been re-assigned to an Agent who is currently at max concurrency.
    • A chat was put in waiting state, when the user replied the chat got allocated back to the agent queue, but the agent was again at max concurrency.
      In all of the scenarios mentioned above, the chat will remain in queue until an agent receives the chat.

      The number of free slots per agent is the difference between the chat concurrency set for the agent and the number of chats currently assigned to the agent.

  • Average Response Time (RT)
    RT calculation is the average time taken by the agent to respond in a chat to all messages and not just the first message. Only the chats which were initiated during the selected time range will be taken into account. In other words, the average time is taken by an agent to consecutively respond to a single or multiple user messages in chronological order.

  • Average Agent Resolution Time
    This metric 'Average agent resolution time' should be the average time taken by the agent from the time when the chat was received till it was completed, re-assigned to, or marked as waiting. Only the chats that were initiated during the selected time range will be taken into account. Agent Resolution time is simply calculated from the user’s first message sent timestamp till the last agent/user message timestamp in a chat, without queue time.

  • Average Agent Idle Time
    It is measured as the number of times an agent was online but not assigned a chat. When creating an entry for idle time, a 10 second threshold is used. Both the overall team level and the agent level would display the aggregated figure of idle time on the UI. The available idle time spans a period of seven days.

Chat Stats


  • Chats Received
    All ongoing chats for a chosen Team view, that started in the selected time duration. This includes chats in waiting, queued chats, and completed chats for the Team in question. The total number of all chats received i.e. first_message_time in the selected time duration from the time-date picker.
  • Closed Chats
    Count all chats that were closed by a human agent that means count all instances of manual clicks for closing a chat. Simply, the total count of chats that were completed by agents in a particular team will be shown here.
    Delete

    Info

    Chats completed by an agent may get reassigned to the bot, and can go back to an agent again. This makes it possible for an agent to close a chat more than once. Hence, the Closed Chats count can be greater than the Total Chats Received count.

  • Chats Abandoned by Users
    This metric counts all conversations which transfer from a Haptik bot to a human agent and the user did not send any message after the human agent was assigned. That means all chats wherein user gets an agent assigned but the user drops-off before sending a message would be counted as an abandoned chat.

    Edge case scenario - Consider another scenario when in conversation A, the user chats with agent 1, and this agent 1 logs out after replying back to the user’s query. In the same conversation A, the user comes back and sends a message, now say this chat goes to agent 2 and the user doesn’t return. Now, if the chat goes to the complete state, we consider this chat as abandoned for agent 2.

  • Delayed Chats
    This metric gets us a count of all instances where the First_agent_response_time is greater than Delay Time value as setup from the Team settings section.

  • Ongoing Chats
    This metric gets us a count of agent chats that were initiated during the query time range, but have not yet been closed.

  • Chats reassigned to other Teams
    This metric gets us a count of the number of chats that were reassigned by agents to agents belonging to a different team.

Agent Statistics

  • Agent Name
    When the agent was created, the username field for an agent is shown here in this name column. You can find the agent name by using the search feature available here.
  • Avg. First Response Time (FRT)
    FRT here in the agent table is the sum of metric queue time and agent first response time as defined above in Time stats the section. However, this metric is for a single agent, And the metric above in Time stats the section is on a Team level.
  • Avg. Response Time (RT)
    Response Time (RT) is the same as defined above in Time statsthe section. Just the change being, this metric is for the single agent. And the metric above is on a Team level.

    Note that FRT and response time metrics shown here for agents and team both include the queue time i.e. the time when the chat was in queue (pending) state. This response time value thus gives us the total time taken to respond to the user.

  • Avg. Resolution Time
    Resolution Time here is the same as defined above in Time stats. Just the change being, this metric is for the single agent. And the metric above is on a Team level.

    Note that resolution time metrics showed here for agents and team both do not include the wait time and the queue time. This resolution time value thus gives us the total time taken by an agent to handle a user chat end to end.

  • Chats received similar to the Total Chats received, this metric is calculated at an agent level. This includes chats that the agent completed, marked as waiting, or chats that were re-assigned to the agent.
  • Avg. User Rating
    User rating here is the same as defined above in the Overview section. Just the change being, this metric is for the single agent. And the metric above is on a Team level.

    Note that the User rating is calculated basis the last agent who claimed the chat. There are scenarios wherein the chat completes and then the user submits feedback. If the claim name had changed from the last agent to another agent, the feedback will get tagged to this new agent. Feedback metric is integral more at a conversation level. And for agents, feedback is a tertiary metric. The reason being the number of feedbacks submitted considered against the volume of daily chats is nominal.

  • Agent Online Time

    When agents are receiving chats, we total this time i.e. to give you a sense of the agent's online activity. This is a useful input to understand agent productivity.

When agents are in an online state and they have pinned chats, they would not get new chats assigned, as they are capped at their concurrency limit. So, we could get scenarios wherein, we have agents online but they don't get new chats and other metrics such as FRT, Resolution Time, etc. are absent. This happens because the agent is not closing chats and is capped at their concurrency. This concurrency cap is the maximum allowed chat count that an agent is allowed to take at any instant.

You get the detailed agent report as per your timezone from a UI click. You can download the agent report. This is allowed for a maximum of 60 days. Also, there is a timezone drop-down using which you can choose the value as per the needs.

You would be able to download the detailed agent data report from the above-shown screen. You can email the report to your id.

Delete

How to analyse Team Data Reports

Refer to this article to learn more about the data present in the Team Data Reports.


Tips to Manage a Team

✅ Track No. of Delayed Chats and optimize agent strength per Team

✅ Track No. of Live Chats received at a given time

✅ View Response Times for a given time frame to monitor agent performance

✅ View Resolution Times on a Team/Agent level

✅ View Individual Chats to get quality feedback

✅ Analyze end of day Team-wise analytics values here.

Delete

Note: 

The conversation on our system is counted within a window of 24-hour from the time it was initiated. You can read more about it, here. 

But, though the conversation is marked complete after 24 hours on the bot, it is made sure that the agent-level metrics are updated on a real-time basis for the teams to analyze, as and when the agent clicks on Chat Complete. 

Was this article helpful?

Yes
No
Give feedback about this article

Related Articles

  • Analytics Overview
  • Analyze Closing Categories on Smart Agent Chat
  • How to Download Agent Performance Reports

Platform

  • Conversation Studio
  • Smart Skills
  • Advanced NLU
  • Intelligent Analytics
  • Omnichannel
  • Smart Agent Chat
  • Enterprise Security
  • Integrations

Solutions

  • Conversational Commerce
  • Lead Generation
  • Customer Care
  • WhatsApp
  • Conversational IVR
  • Google Business Messages

Industries

  • Retail/ E-Commerce
  • Financial Services
  • Travel & Hospitality
  • Telecom

Knowledge

  • ROI Calculator
  • Reports & Research
  • Case Studies
  • Webinars
  • ISAT
  • Tech Blog
  • Business Blog
  • Resources
  • Haptik v/s Yellow
  • Haptik v/s Liveperson
  • Haptik v/s IBM Watson
  • Haptik v/s Verloop
  • Conversations on AI

Company

  • Why Haptik
  • About Us
  • Careers
  • News & Media
  • Awards & Recognition
  • Contact Us
  • Partnerships
  • Investor Relations

Subscribe

Sign up to recieve the latest updates

Find us on

  • Twitter-footer
  • Linkedin-footer
  • YT-footer
  • Insta-footer
  • G2-footer
  • Facebook-footer

Knowledge Base Software powered by Helpjuice

Copyright © jio Haptik Technology Limited 2021 | Data Security & Privacy Policy | GDPR

North America | Asia Pacific | Africa | enterprise@haptik.ai

Definition by Author

0
0