The following is a demonstration of how you can visualize the data using Tableau.

The Haptik-Tableau integration uses AWS S3, Athena, and Tableau Athena Connector.

With the Amazon Athena connector, you can quickly and directly connect Tableau to your Amazon S3 data for fast discovery and analysis, with drag-and-drop ease. Amazon Athena connects to Tableau via a JDBC driver.

Follow these stages to take full advantage of the feature:

• Install the latest version of 64-bit Java
• Get the Athena driver
• Place the driver -
  • Windows: Save the Amazon Athena JDBC jar in the C:\Program Files\Tableau\Drivers location
  • Mac: Save the Amazon Athena JDBC jar in the ~/Library/Tableau/Drivers location
• Restart Tableau

Configure Amazon Athena Connection

Once these stages are completed, you can add a new Amazon Athena connection and begin configuring it.

1. Connecting Tableau to AWS Athena
   
   
   
2. After selecting the Amazon Athena connector, dialog box will open
   
   Need to fill up the following details -
   • Server: athena.region.amazon.com
     For example, Athena.ap-southeast-1.amazonaws.com
   • Port: 443 SSL by default
   • Amazon S3 Staging Directory: Find this setting in the AWS console for Amazon Athena.
     AWS calls this property “Query Result Location”
   • Username/Password: Access Key ID and Secret Access Key
     Access Key ID and Secret Access Key associated with the IAM user you are logging in as.
     
     
3. Once connected, it will show the DataBase and Tables created in Athena
   
   
4. Select the table and click on view data
   
5. Once data is loaded you can create the sheets and dashboard out of it

Creating Dashboard for Haptik Data

Once the data appears on Tableau from Athena, you can visualize it by creating multiple dashboards. Let's try to build a dashboard using message tables, which have a data column with nested JSON.

You need to make the nested JSON into a flat table using a custom query to retrieve the data. In Datasource Tab in Tableau, we can select New Custom SQL and write the Query and Select OK.

Select the new Sheet and create the graph you want to visualize.

We have created the sample Story Graph. We selected the story and the count of the story using Bar Graph.

The graph was created using Message Logs. Similarly, you can visualize other logs.

Loading data from AWS S3 into Athena

1. Set Up AWS Account
2. Select Athena Service from AWS Console
3. Select Query editor tab
4. Insert the Create table query to load data from S3 and Run the Query. On successful execution of the query, a table will be created.

Sample Custom Query in Athena

SELECT "haptik_message_2"."type" AS "type",
"haptik_message_2"."data" AS "data",
"haptik_message_2"."data"."is_freeform" AS "is_freeform",
"haptik_message_2"."data"."top_node" AS "top_node",
"haptik_message_2"."data"."node_list" AS "node_list",
"haptik_message_2"."data"."smalltalk_intent_tag" AS "smalltalk_intent_tag",
"haptik_message_2"."cas_name" AS "cas_name",
"haptik_message_2"."environment" AS "environment"
FROM "datalake"."haptik_message_2021_06_08" "haptik_message_2"