Related Topics: @BigDataExpo, @CloudExpo, @ThingsExpo

@BigDataExpo: Blog Feed Post

Effective Analytics | @BigDataExpo #BigData #IoT #M2M #DigitalTransformation

Measure the effectiveness of whatever decisions are ultimately made in order to continuously refine the analytic models

I was reading an interview with John Krafcik, CEO of Google’s Self-driving Car Project, in the August 8th issue of Bloomberg BusinessWeek. The article referenced a survey by AlixPartners where they found that 73% of people wanted autonomous vehicles.  But when people had the option to have a steering wheel in the car, allowing optional full control to the driver, the acceptance rate jumped to 90%.  This finding, that people are much more accepting of automation and new ideas when they have the option of control, is totally consistent with what we found with respect to how to deliver big data analytics.

The big data engagements we run for EMC focus on applying predictive and prescriptive analytics to deliver recommendations to help key decision makers become more effective at at their jobs.  For example, delivering recommendations to teachers in how to best group their students based upon the subject area, or to mechanics regarding what parts to replace when performing maintenance on a wind turbine, or to physicians regarding what medications and treatments will likely deliver the best results given a patient’s overall wellness, or to appraisers to help them more accurately determine the value of a property, or to an underwriter to help them to determine which loans to accept given a reasonable level of risk, or etc.

But how does one ensure that the business stakeholders, the humans in the process, are accepting of the analytics and recommendations that are being delivered to them? Being right doesn’t necessarily make you persuasive.

Effective Recommendations Put Humans in Control
We learned through several engagements that as we deliver recommendations to business stakeholders or directly to customers involved in the process or decision that we had to provide three options to the humans in order to ensure their buy-in to the analytics.  Those three options that we presented to the business stakeholders were:

  • They could accept the recommendation and we would measure how effective the outcome was versus the model, or
  • They could reject the recommendation and we would measure how effective the outcome was versus the model, or
  • They could change the recommendation and we would measure how effective the outcome was versus the model.

Note:  in some situations, we also offered the option to select the [MORE] option to get more details (usually presented as interactive charts or tables) in support of the recommendation.  But after a while, we found that the users seldom selected that option

For example, the organization may be executing on a customer retention business initiative.  The organization could be applying big data analytics to deliver retention offers (new services, lower prices, more features, etc.) to their “high value, at risk” customers based upon the likelihood of the customer’s attrition (Customer Attrition Score) and the customer’s potential lifetime value (Maximum Customer LTV Score).  So when Jane Smith calls the call center about a billing issue, the model would look up Jane’s “Customer Attrition Score” and “Maximum Customer LTV Score” to recommend a specific retention offer to the customer service representation.

Let’s say that the data indicates that Jane has a high likelihood of attrition (based upon a change in her usage behaviors and social media sentiment) and that she has a very high “Maximum Customer LTV Score” (based upon both the number of additional services that could be sold to Jane, plus her strong social media following).  The prescriptive model may recommend the following retention offer:

[Offer Jane 10% off of her current cable service over the next 3 months]

The call center representative has the options to:

  • Accept the recommendation and make that offer to Jane, or
  • Reject the recommendation and make no offer to Jane, or
  • Change the recommendation based upon the conversation that the Customer Service Rep is having with Jane.

Let’s say that the Customer Service Rep decides that the best offer for Jane (based upon the conversation the Customer Service Rep is having with Jane) is to:

[Offer Jane 50% off new high-speed Internet service over next 6 months]

The customer service rep may have learned from their conversation that Jane’s biggest usage problem was streaming her favorite shows during her weekend binge watching.  With this additional insight in hand, and the knowledge from the scores about Jane’s likelihood to attrite and her potential life time value, the customer service rep made the decision to change the recommendation to something that the customer service rep felt was more relevant to the problems that Jane was having.

Test, Measure and Learn for Continuous Model Evolution
In all cases, we want to measure the effectiveness of whatever decisions are ultimately made in order to continuously refine the analytic models and scores.  By constantly measuring the effectiveness of the recommendations AND allowing the humans in the process the freedom to test different ideas, the models can learn from the humans.

More importantly, there are always going to be some humans who produce better results than the models due to their experiences, training, and intuition (or in some cases, dumb luck).  Humans may be able to react and adjust to new information (coming from the interaction that they are having with the customers) than the time required to update and re-run the models.  In the end, involving the humans as a key factor in the analytics process will ensure that models don’t go stale and that the models are constantly improving.

As the BusinessWeek article highlighted, humans will usually be more receptive to new ideas and new technologies if they feel like they are still in control.  If you want your decision makers to accept the recommendations of your analytics, then you had better allow the humans an opportunity to provide feedback to the models.  This a clear win-win-win for everyone – data scientists who are building the analytic models, business stakeholders who are interacting with the analytic results, and the customers with whom we are trying to provide a differentiated experience.

The post Effective Analytics Put the Humans In Control appeared first on InFocus.

More Stories By William Schmarzo

Bill Schmarzo, author of “Big Data: Understanding How Data Powers Big Business”, is responsible for setting the strategy and defining the Big Data service line offerings and capabilities for the EMC Global Services organization. As part of Bill’s CTO charter, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He’s written several white papers, avid blogger and is a frequent speaker on the use of Big Data and advanced analytics to power organization’s key business initiatives. He also teaches the “Big Data MBA” at the University of San Francisco School of Management.

Bill has nearly three decades of experience in data warehousing, BI and analytics. Bill authored EMC’s Vision Workshop methodology that links an organization’s strategic business initiatives with their supporting data and analytic requirements, and co-authored with Ralph Kimball a series of articles on analytic applications. Bill has served on The Data Warehouse Institute’s faculty as the head of the analytic applications curriculum.

Previously, Bill was the Vice President of Advertiser Analytics at Yahoo and the Vice President of Analytic Applications at Business Objects.

Latest Stories
SYS-CON Events announced today that Bsquare has been named “Silver Sponsor” of SYS-CON's @ThingsExpo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. For more than two decades, Bsquare has helped its customers extract business value from a broad array of physical assets by making them intelligent, connecting them, and using the data they generate to optimize business processes.
SYS-CON Events has announced today that Roger Strukhoff has been named conference chair of Cloud Expo and @ThingsExpo 2016 Silicon Valley. The 19th Cloud Expo and 6th @ThingsExpo will take place on November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. "The Internet of Things brings trillions of dollars of opportunity to developers and enterprise IT, no matter how you measure it," stated Roger Strukhoff. "More importantly, it leverages the power of devices and the Interne...
We’ve been doing it for years, decades for some. How many websites have you created accounts on? Your bank, your credit card companies, social media sites, hotels and travel sites, online shopping sites, and that’s just the start. We do it often without even thinking about it, quickly entering our personal information, our data, in a plethora of systems. Sometimes we’re not even aware of the information we are providing. It could be very personal information (think of the security questions you ...
19th Cloud Expo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterpri...
In this strange new world where more and more power is drawn from business technology, companies are effectively straddling two paths on the road to innovation and transformation into digital enterprises. The first path is the heritage trail – with “legacy” technology forming the background. Here, extant technologies are transformed by core IT teams to provide more API-driven approaches. Legacy systems can restrict companies that are transitioning into digital enterprises. To truly become a lea...
According to Forrester Research, every business will become either a digital predator or digital prey by 2020. To avoid demise, organizations must rapidly create new sources of value in their end-to-end customer experiences. True digital predators also must break down information and process silos and extend digital transformation initiatives to empower employees with the digital resources needed to win, serve, and retain customers.
Businesses are struggling to manage the information flow and interactions between all of these new devices and things jumping on their network, and the apps and IT systems they control. The data businesses gather is only helpful if they can do something with it. In his session at @ThingsExpo, Chris Witeck, Principal Technology Strategist at Citrix, will discuss how different the impact of IoT will be for large businesses, expanding how IoT will allow large organizations to make their legacy ap...
Video experiences should be unique and exciting! But that doesn’t mean you need to patch all the pieces yourself. Users demand rich and engaging experiences and new ways to connect with you. But creating robust video applications at scale can be complicated, time-consuming and expensive. In his session at @ThingsExpo, Zohar Babin, Vice President of Platform, Ecosystem and Community at Kaltura, will discuss how VPaaS enables you to move fast, creating scalable video experiences that reach your...
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life sett...
Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 19th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devices - comp...
SYS-CON Events announced today that SoftLayer, an IBM Company, has been named “Gold Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2016, at the Javits Center in New York, New York. SoftLayer, an IBM Company, provides cloud infrastructure as a service from a growing number of data centers and network points of presence around the world. SoftLayer’s customers range from Web startups to global enterprises.
Cloud computing is being adopted in one form or another by 94% of enterprises today. Tens of billions of new devices are being connected to The Internet of Things. And Big Data is driving this bus. An exponential increase is expected in the amount of information being processed, managed, analyzed, and acted upon by enterprise IT. This amazing is not part of some distant future - it is happening today. One report shows a 650% increase in enterprise data by 2020. Other estimates are even higher....
One of biggest questions about Big Data is “How do we harness all that information for business use quickly and effectively?” Geographic Information Systems (GIS) or spatial technology is about more than making maps, but adding critical context and meaning to data of all types, coming from all different channels – even sensors. In his session at @ThingsExpo, William (Bill) Meehan, director of utility solutions for Esri, will take a closer look at the current state of spatial technology and ar...
Fifty billion connected devices and still no winning protocols standards. HTTP, WebSockets, MQTT, and CoAP seem to be leading in the IoT protocol race at the moment but many more protocols are getting introduced on a regular basis. Each protocol has its pros and cons depending on the nature of the communications. Does there really need to be only one protocol to rule them all? Of course not. In his session at @ThingsExpo, Chris Matthieu, co-founder and CTO of Octoblu, walk you through how Oct...
The vision of a connected smart home is becoming reality with the application of integrated wireless technologies in devices and appliances. The use of standardized and TCP/IP networked wireless technologies in line-powered and battery operated sensors and controls has led to the adoption of radios in the 2.4GHz band, including Wi-Fi, BT/BLE and 802.15.4 applied ZigBee and Thread. This is driving the need for robust wireless coexistence for multiple radios to ensure throughput performance and th...