Welcome!

Blog Feed Post

The Art of Data Visualization

In my last blog, we looked at how data is aggregated based on the trend of data. In this article, we discuss how this data is represented to users in a more meaningful way.

The raw data for thousands of websites across different geographies that are measuring network components, page performance, availability, and page content metrics is saved in huge databases. When this data is presented to humans without organizing and categorizing properly, it’s difficult to read, analyze, and identify conclusions.

Presenting these data sets by organizing and categorizing in a graphical format makes it easier to achieve your goals. Here, we will look at different chart types, which are used more frequently in performance analytics, and which are used in various scenarios based on the data type.

Most commonly used chart types

  1. Bar Chart
  2. Line Chart
  3. Scatter Plot Chart
  4. Histogram
  5. Cumulative Distribution Chart
  6. Geo Chart
  7. Bubble Chart

To determine the chart types that represent a set of data accurately, let’s look at some real-world scenarios in performance analytics.

Use Case 1

Often when analyzing performance data, we come across situations where we need to rank the data based on certain qualitative data. For example, consider the qualitative data for performance of a website across different cities in the US; let us try to determine which chart would help interpret the data in the best way.

Bar charts display the data in the form of vertical bars. This works in scenarios where we need to compare different qualitative data that can be categorized. So, bar graphs are appropriate when we want to represent ranking data in performance analysis.

Catchpoint’s digital experience intelligence platform provides the option to generate bar graphs at distinct levels of breakdown which is an effective way to represent qualitative data in a ranking order.

http://blog.catchpoint.com/wp-content/uploads/2017/06/chart1-300x124.png 300w, http://blog.catchpoint.com/wp-content/uploads/2017/06/chart1-768x318.png 768w" sizes="(max-width: 967px) 100vw, 967px" />

The above bar chart shows webpage load time ranking across different cities in the US; it is easy to figure out which city performed well over others looking at this chart.

Use Case 2

Consider another scenario where performance data needs to be studied over a period to see if there is any change in performance.

A line graph can be used to represent the continued distribution of quantitative performance data of a website over a specific period. This can determine the range of time when the performance was affected. Catchpoint can provide flexibility to plot line graph for 10 different metrics at once to provide an in-depth detail to find the root cause of the issue.

http://blog.catchpoint.com/wp-content/uploads/2017/06/chart2-300x221.png 300w" sizes="(max-width: 675px) 100vw, 675px" />

From the above line graph chart, we see that there was a change in the performance in the month of October as there was an increase in the total number of contents on the page.

So, a line graph can help understand performance variations and to analyze the root cause behind the change in performance over a period of time.

Use Case 3

Error filtering is an important part of data analytics. It helps identify different errors, and the time the errors occurred to evaluate the availability of the website. This also helps in evaluating website availability; hence, this chart type is frequently used in performance analysis to monitor the availability of a website.

Some solutions offer an effortless way to filter different error types in a specific time frame. A scatterplot chart is a straightforward way to visualize all these errors, it plots every test run that had a failure.

http://blog.catchpoint.com/wp-content/uploads/2017/06/chart3-300x133.png 300w, http://blog.catchpoint.com/wp-content/uploads/2017/06/chart3-768x340.png 768w" sizes="(max-width: 979px) 100vw, 979px" />

The above graph shows all the errors which occurred in a specified time interval for a web test, each data point can be analyzed further by clicking on a data point and viewing the waterfall data.

A scatterplot can also be used to visualize different patterns of data for an in-depth root cause analysis. For example, consider a scenario where the page performance is impacted by the high response time of a file. Analyzing the data points reveals that the file was served from different servers and some of these servers were sending the file uncompressed and these uncompressed files added latency to the page load.

The scatterplot graph below shows different bands of data for file 1 and file 2, each of which has an uncompressed and compressed version served from different servers. The response time of the compressed file was much better than the larger uncompressed file as it takes longer to deliver higher bytes of data to the client from the server.

http://blog.catchpoint.com/wp-content/uploads/2017/06/chart4-300x267.png 300w" sizes="(max-width: 464px) 100vw, 464px" />

Use Case 4

In performance analytics, it is important to know the number of data points present in the threshold range of a performance metric. This would be useful to evaluate how many users were affected by low performance and how many experienced reliable performance.

Categorizing data into range buckets will help you understand how many data points were within the desired threshold range for that website. It can also help with further analysis for the data sets that had low performance.

A histogram chart can be used to represent data distribution in range buckets. Each bucket depicts the performance metric range and the number of data sets which fall in that range.

http://blog.catchpoint.com/wp-content/uploads/2017/06/chart5-300x184.png 300w" sizes="(max-width: 602px) 100vw, 602px" />

The histogram graph above shows the number of data runs on the Y axis and the range of webpage load time on the X axis. The second bar shows that there were 232 runs which had webpage response time in the range of 5.3 – 6 seconds.

The histogram gives a range bucket for looking at the number of affected users while a cumulative distribution graph gives the percent of users who crossed the threshold value for that performance metric.

Cumulative distribution graph is a commonly used chart type to express the performance metrics in percentile; it plots the percent of users who had performance metric greater or lesser than the threshold for the website.

The graph below shows the CDF graph for webpage response time

http://blog.catchpoint.com/wp-content/uploads/2017/06/chart6-300x126.png 300w, http://blog.catchpoint.com/wp-content/uploads/2017/06/chart6-768x321.png 768w" sizes="(max-width: 999px) 100vw, 999px" />

From the CDF graph above, we see that at the 90th percentile, the webpage response time of a website is 10.3 seconds. This means that 10% of the users in the time frame that the data was collected in had an overall webpage load time of more than 10.3 seconds.

Use Case 5

When a website is hosted at multiple locations, it becomes necessary to evaluate its performance from different geographic points. Catchpoint offers Geo Charts that display performance based on the data point’s magnitude from green for good to red for bad performance.

http://blog.catchpoint.com/wp-content/uploads/2017/06/chart7-300x149.png 300w, http://blog.catchpoint.com/wp-content/uploads/2017/06/chart7-768x382.png 768w, http://blog.catchpoint.com/wp-content/uploads/2017/06/chart7-1024x510.png 1024w" sizes="(max-width: 1354px) 100vw, 1354px" />

The geo chart above shows how the performance of a single website varies across geographies. From the graph, we see users in USA and Europe experienced the best webpage load time, whereas the user in China experienced higher webpage load time.

Use Case 6

The chart types we discussed so far focus on a single metric which can be selected for evaluating the performance. What if we want to evaluate the performance of more than 1 metric or for a set of different websites?

In such scenarios, Bubble charts are a good option to evaluate multiple performance metrics for different websites in a single view.

http://blog.catchpoint.com/wp-content/uploads/2017/06/chart8-300x281.png 300w" sizes="(max-width: 696px) 100vw, 696px" />

The above bubble chart gives the performance (Document Complete, Webpage Response) of 3 different websites under a single view.

Conclusion

From the above-mentioned scenarios, visualization is a powerful way to express data in a more meaningful manner. It helps in finding the root cause of an issue and drawing conclusions to narrow the areas that require optimization.

The different charts types available in Catchpoint helps you slice and dice the data in diverse ways to analyze the data. In addition to analyzing the data, it is also important to monitor the trend in performance across different webpages or competitor’s website to know how the system behaves over time.

http://blog.catchpoint.com/wp-content/uploads/2017/06/chart9-300x67.png 300w, http://blog.catchpoint.com/wp-content/uploads/2017/06/chart9-768x172.png 768w, http://blog.catchpoint.com/wp-content/uploads/2017/06/chart9-1024x229.png 1024w" sizes="(max-width: 1553px) 100vw, 1553px" />

Catchpoint provides an option to create a custom visualization for different scenarios for monitoring and analyzing performance trends to suit the needs of every user. We will look deeper into custom chart types and custom visualizations in our upcoming blogs.

The post The Art of Data Visualization appeared first on Catchpoint's Blog - Web Performance Monitoring.

Read the original blog entry...

More Stories By Mehdi Daoudi

Catchpoint radically transforms the way businesses manage, monitor, and test the performance of online applications. Truly understand and improve user experience with clear visibility into complex, distributed online systems.

Founded in 2008 by four DoubleClick / Google executives with a passion for speed, reliability and overall better online experiences, Catchpoint has now become the most innovative provider of web performance testing and monitoring solutions. We are a team with expertise in designing, building, operating, scaling and monitoring highly transactional Internet services used by thousands of companies and impacting the experience of millions of users. Catchpoint is funded by top-tier venture capital firm, Battery Ventures, which has invested in category leaders such as Akamai, Omniture (Adobe Systems), Optimizely, Tealium, BazaarVoice, Marketo and many more.

Latest Stories
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
SYS-CON Events announced today that MobiDev, a client-oriented software development company, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MobiDev is a software company that develops and delivers turn-key mobile apps, websites, web services, and complex software systems for startups and enterprises. Since 2009 it has grown from a small group of passionate engineers and business...
What's the role of an IT self-service portal when you get to continuous delivery and Infrastructure as Code? This general session showed how to create the continuous delivery culture and eight accelerators for leading the change. Don Demcsak is a DevOps and Cloud Native Modernization Principal for Dell EMC based out of New Jersey. He is a former, long time, Microsoft Most Valuable Professional, specializing in building and architecting Application Delivery Pipelines for hybrid legacy, and cloud ...
The Internet giants are fully embracing AI. All the services they offer to their customers are aimed at drawing a map of the world with the data they get. The AIs from these companies are used to build disruptive approaches that cannot be used by established enterprises, which are threatened by these disruptions. However, most leaders underestimate the effect this will have on their businesses. In his session at 21st Cloud Expo, Rene Buest, Director Market Research & Technology Evangelism at Ar...
SYS-CON Events announced today that GrapeUp, the leading provider of rapid product development at the speed of business, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market acr...
SYS-CON Events announced today that Ayehu will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on October 31 - November 2, 2017 at the Santa Clara Convention Center in Santa Clara California. Ayehu provides IT Process Automation & Orchestration solutions for IT and Security professionals to identify and resolve critical incidents and enable rapid containment, eradication, and recovery from cyber security breaches. Ayehu provides customers greater control over IT infras...
21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Me...
DevOps at Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to w...
We build IoT infrastructure products - when you have to integrate different devices, different systems and cloud you have to build an application to do that but we eliminate the need to build an application. Our products can integrate any device, any system, any cloud regardless of protocol," explained Peter Jung, Chief Product Officer at Pulzze Systems, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA
"Loom is applying artificial intelligence and machine learning into the entire log analysis process, from start to finish and at the end you will get a human touch,” explained Sabo Taylor Diab, Vice President, Marketing at Loom Systems, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
With the introduction of IoT and Smart Living in every aspect of our lives, one question has become relevant: What are the security implications? To answer this, first we have to look and explore the security models of the technologies that IoT is founded upon. In his session at @ThingsExpo, Nevi Kaja, a Research Engineer at Ford Motor Company, discussed some of the security challenges of the IoT infrastructure and related how these aspects impact Smart Living. The material was delivered interac...
Artificial intelligence, machine learning, neural networks. We’re in the midst of a wave of excitement around AI such as hasn’t been seen for a few decades. But those previous periods of inflated expectations led to troughs of disappointment. Will this time be different? Most likely. Applications of AI such as predictive analytics are already decreasing costs and improving reliability of industrial machinery. Furthermore, the funding and research going into AI now comes from a wide range of com...
The financial services market is one of the most data-driven industries in the world, yet it’s bogged down by legacy CPU technologies that simply can’t keep up with the task of querying and visualizing billions of records. In his session at 20th Cloud Expo, Karthik Lalithraj, a Principal Solutions Architect at Kinetica, discussed how the advent of advanced in-database analytics on the GPU makes it possible to run sophisticated data science workloads on the same database that is housing the rich...
"When we talk about cloud without compromise what we're talking about is that when people think about 'I need the flexibility of the cloud' - it's the ability to create applications and run them in a cloud environment that's far more flexible,” explained Matthew Finnie, CTO of Interoute, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.