Welcome!

Blog Feed Post

Becoming “Netflix Intelligent”: Something Every Company Can Do!

Nobody does it better,

Makes me feel sad for the rest.

Nobody does it half as good as you,

Baby, you’re the best.

–Sung by Carly Simon in the James Bond movie, “The Spy Who Loved Me”

Actually, that’s a movie (“The Spy that Loved Me”) that Netflix recommends for me since I’m a James Bond junkie and Netflix knows that. In fact, Netflix knows a lot about me as it knows a lot about all of its viewers, which is one reason why Netflix is a Wall Street darling and has rewarded its stockholders very well over the past couple of years (see Figure 1).

Figure 1: Netflix Stock Price

Figure 1: Netflix Stock Price

 

But Netflix isn’t doing anything that other organizations cannot do. To replicate Netflix’s business success starts with thinking differently about the role of data and analytics in powering the organization’s business. And while I do not have any “insider secrets” to what Netflix does, it doesn’t take James Bond to piece together the secrets to their success.

The Secret Ingredients to Netflix’s Success

The secret to Netflix’s success comes from the power of combining detailed viewer behavioral data and detailed show/program characteristics data with machine learning to make predictions about what shows what viewers might want to watch. This is a recipe that every company can and should follow! And it’s really not a hard recipe, if you have the right ingredients:

Becoming_Netflix_Intelligent_photo-2

Ingredient #1: Targeted Use Case

You can’t get to the “What” and the “Why” by focusing on the “How”

They key to any organization’s big data and data science success starts by identifying the “What” and the “Why; that is, “what” are the business use cases upon which your big data and data science initiative should focus and “why” are these use cases important to the business.

Netflix’s market domination and outstanding business performance rests on their ability to improve customer retention and drive customer loyalty through increased viewer engagement. And the heart of Netflix’s increasing viewer engagement is their movie recommendation engine (see Figure 2).

Figure 2: Netflix Recommendation Engine

Figure 2: Netflix Recommendation Engine

 

The movie recommendation engine has been incredibly successful in increasing viewer engagement. The number of hours the average viewer watches Netflix has increased an average of 16.4% per year since 2011. The average Netflix viewer watched almost 12 days more Netflix in 2016 than they did in 2011 (see Figure 3)[1]!

Figure 3: Average Netflix Viewing Hours

Figure 3: Average Netflix Viewing Hours

Ingredient #2: Create Analytic (Viewer) Profiles

Netflix has over 250 million active viewers worldwide. From their individual profiles, Netflix is able to determine what people watch, what they watch after, what they watch before, what they watched a year ago, what they’ve watched recently and what time of day[2]. This viewer viewing behavior data forms the foundation for their business model.

But it isn’t just the data. It’s critical to be constantly mining the viewers’ viewing behaviors to uncover insights about that individual viewer – their viewing behaviors, preferences, tendencies, inclinations, trends, biases and patterns (see Figure 4).

Figure 4: Big Data is Learning About Individual Behaviors

Figure 4: Big Data is Learning about Individual Behaviors

Being able to integrate viewers’ viewing behaviors with external data sources makes the customer data even more valuable…and actionable from a recommendations perspective. For example, we could learn more about viewers’ interests, passions, affiliations and associations from their social media engagements on Facebook, Twitter, Snapchat and LinkedIn. We can measure their strength of advocacy for certain programs and types (genre) of programs based upon what they are saying publicly on social media sites.

We can capture all these analytic and behavioral insights in a customer Analytic Profile. Analytic Profiles capture the organization’s analytic assets in a way that facilities the refinement and sharing of those analytic assets across multiple use cases. An Analytic Profile consists of metrics, predictive indicators, segments, scores, and business rules that codify the behaviors, preferences, propensities, inclinations, tendencies, interests, associations and affiliations for the organization’s key business entities such as customers, patients, students, athletes, jet engines, cars, locomotives, CAT scanners, and wind turbines (see Figure 5).

Slide_Analytic_Profile_Customer

Figure 5: Customer Analytic Profile

Analytic Profiles enforce a discipline in the capture and re-use of analytics insights at the level of the individual key business entity. See the following blogs for more details on the concept and application of Analytic Profiles:

Ingredient #3: Capture Show Characteristics and Viewing Patterns

In much the same way that organization can build detailed analytic profiles on all of their customers (viewers), organizations can also build detailed analytic profiles on all their products …at the level of the individual product. Individual products (e.g., cars, wind turbines, medical devices, jet engines, CAT machines) develop unique “fingerprints” that can be used to distinguish between the different operational behaviors of the different products.

I have no insider’s knowledge into how Netflix classifies their programs and shows, but I did find an article titled “So How Does Netflix Categorize Titles in Its Film & TV Libraries?” that talks about how Netflix classifies shows:

“[Viewing Analysts use] a spreadsheet to take notes of all the info that goes into the 100+ data points used by Netflix to tag each title.”

Now to a certain extent, Netflix has it easy because their “products” are all unique and there is a bounty of external data about each of their “products” from sites such as Rotten Tomatoes, IMDb, Common Sense Media and Flixster. But having the data is very different from knowing what you want to do with that data.

Ingredient #4: Mastering Machine Learning

As we discussed above, Netflix has access to a broad set of viewer viewing data—what each member watches, when they watch, the place on the Netflix screen the customer found the video, recommendations the customer didn’t choose, the popularity of videos in the catalog, etc. All of this data gets fed into supervised (classification, regression) and unsupervised (dimensionality reduction through clustering or compression) Machine Learning algorithms to create critical scores such as:

  • A video-to-video Similarity algorithm makes recommendations in the “Because You Watched” row.
  • A Video Ranker algorithm then selects the order of videos in genre rows for each individual viewer[3].
Becoming_Netflix_Intelligent_photo-9

Figure 6: The training and evaluation of algorithms takes place offline, while A/B testing takes place online. Images adopted from ACM.

 

 

 

 

 

 

 

 

 

 

Understanding how Machine Learning works isn’t hard (See “What tomorrow’s business leaders need to know about Machine Learning?” for more details.). And while there certainly is an art and a perseverance necessary to explore the different types of structured and unstructured machine learning algorithms to find the ones that work best, the key to the success is to have a data science exploration and learning process that allows the data science teams to explore the bounty of viewer and show data in search of those variables and metrics that might be better predictors of viewer’s behaviors (see Figure 7).

Slide_Data_Science_Exploration_and_Learning_Process

Figure 7: Data Science and Exploration and Learning Process

See the blog “Dynamic Duo of Analytic Power” for more details on the Data Science exploration and learning process.

Ingredient #5: Management Fortitude to Become “Netflix Intelligent”

Ingredient #5 is probably the one ingredient that trips up most organizations because none of the other ingredients mean a thing if you don’t have a management team that knows how to properly value and use the organization’s data and analytics. Netflix is a digital-first company, but they weren’t always that way. Netflix started as a company that shipped movies to their customers using physical DVD’s. But as technology capabilities (increased bandwidth and availability of internet access) and market demands changed (people wanted to watch their movies now, not two days later), Netflix made the hard digital transformation.

Becoming “Netflix Intelligent” is something that any organization can do today. There is nothing magical about the data or the technologies. It just takes an approach and a willingness to act. I’ve just given you the approach. Now the key question is “Do you have the willingness?”

Sources:

[1] “Average Netflix Subscriber Watches Almost Twice as Much Netflix as They Did 5 Years Ago”

[2] “This is How Netflix’s Top-Secret Recommendation System Works”

[3] “How Machine Learning Fuels Your Netflix Addiction”

 

The post Becoming “Netflix Intelligent”: Something Every Company Can Do! appeared first on InFocus Blog | Dell EMC Services.

Read the original blog entry...

More Stories By William Schmarzo

Bill Schmarzo, author of “Big Data: Understanding How Data Powers Big Business”, is responsible for setting the strategy and defining the Big Data service line offerings and capabilities for the EMC Global Services organization. As part of Bill’s CTO charter, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He’s written several white papers, avid blogger and is a frequent speaker on the use of Big Data and advanced analytics to power organization’s key business initiatives. He also teaches the “Big Data MBA” at the University of San Francisco School of Management.

Bill has nearly three decades of experience in data warehousing, BI and analytics. Bill authored EMC’s Vision Workshop methodology that links an organization’s strategic business initiatives with their supporting data and analytic requirements, and co-authored with Ralph Kimball a series of articles on analytic applications. Bill has served on The Data Warehouse Institute’s faculty as the head of the analytic applications curriculum.

Previously, Bill was the Vice President of Advertiser Analytics at Yahoo and the Vice President of Analytic Applications at Business Objects.

Latest Stories
SYS-CON Events announced today that Massive Networks, that helps your business operate seamlessly with fast, reliable, and secure internet and network solutions, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. As a premier telecommunications provider, Massive Networks is headquartered out of Louisville, Colorado. With years of experience under their belt, their team of...
SYS-CON Events announced today that IBM has been named “Diamond Sponsor” of SYS-CON's 21st Cloud Expo, which will take place on October 31 through November 2nd 2017 at the Santa Clara Convention Center in Santa Clara, California.
Infoblox delivers Actionable Network Intelligence to enterprise, government, and service provider customers around the world. They are the industry leader in DNS, DHCP, and IP address management, the category known as DDI. We empower thousands of organizations to control and secure their networks from the core-enabling them to increase efficiency and visibility, improve customer service, and meet compliance requirements.
In his session at 21st Cloud Expo, Michael Burley, a Senior Business Development Executive in IT Services at NetApp, will describe how NetApp designed a three-year program of work to migrate 25PB of a major telco's enterprise data to a new STaaS platform, and then secured a long-term contract to manage and operate the platform. This significant program blended the best of NetApp’s solutions and services capabilities to enable this telco’s successful adoption of private cloud storage and launchi...
SYS-CON Events announced today that TidalScale will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. TidalScale is the leading provider of Software-Defined Servers that bring flexibility to modern data centers by right-sizing servers on the fly to fit any data set or workload. TidalScale’s award-winning inverse hypervisor technology combines multiple commodity servers (including their ass...
As hybrid cloud becomes the de-facto standard mode of operation for most enterprises, new challenges arise on how to efficiently and economically share data across environments. In his session at 21st Cloud Expo, Dr. Allon Cohen, VP of Product at Elastifile, will explore new techniques and best practices that help enterprise IT benefit from the advantages of hybrid cloud environments by enabling data availability for both legacy enterprise and cloud-native mission critical applications. By rev...
As popularity of the smart home is growing and continues to go mainstream, technological factors play a greater role. The IoT protocol houses the interoperability battery consumption, security, and configuration of a smart home device, and it can be difficult for companies to choose the right kind for their product. For both DIY and professionally installed smart homes, developers need to consider each of these elements for their product to be successful in the market and current smart homes.
Join IBM November 1 at 21st Cloud Expo at the Santa Clara Convention Center in Santa Clara, CA, and learn how IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Cognitive analysis impacts today’s systems with unparalleled ability that were previously available only to manned, back-end operations. Thanks to cloud processing, IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Imagine a robot vacuum that becomes your personal assistant tha...
Companies are harnessing data in ways we once associated with science fiction. Analysts have access to a plethora of visualization and reporting tools, but considering the vast amount of data businesses collect and limitations of CPUs, end users are forced to design their structures and systems with limitations. Until now. As the cloud toolkit to analyze data has evolved, GPUs have stepped in to massively parallel SQL, visualization and machine learning.
In his Opening Keynote at 21st Cloud Expo, John Considine, General Manager of IBM Cloud Infrastructure, will lead you through the exciting evolution of the cloud. He'll look at this major disruption from the perspective of technology, business models, and what this means for enterprises of all sizes. John Considine is General Manager of Cloud Infrastructure Services at IBM. In that role he is responsible for leading IBM’s public cloud infrastructure including strategy, development, and offering ...
SYS-CON Events announced today that N3N will exhibit at SYS-CON's @ThingsExpo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. N3N’s solutions increase the effectiveness of operations and control centers, increase the value of IoT investments, and facilitate real-time operational decision making. N3N enables operations teams with a four dimensional digital “big board” that consolidates real-time live video feeds alongside IoT sensor data a...
In his session at 21st Cloud Expo, Raju Shreewastava, founder of Big Data Trunk, will provide a fun and simple way to introduce Machine Leaning to anyone and everyone. Together we will solve a machine learning problem and find an easy way to be able to do machine learning without even coding. Raju Shreewastava is the founder of Big Data Trunk (www.BigDataTrunk.com), a Big Data Training and consulting firm with offices in the United States. He previously led the data warehouse/business intellige...
In a recent survey, Sumo Logic surveyed 1,500 customers who employ cloud services such as Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP). According to the survey, a quarter of the respondents have already deployed Docker containers and nearly as many (23 percent) are employing the AWS Lambda serverless computing framework. It’s clear: serverless is here to stay. The adoption does come with some needed changes, within both application development and operations. Tha...
SYS-CON Events announced today that Avere Systems, a leading provider of enterprise storage for the hybrid cloud, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Avere delivers a more modern architectural approach to storage that doesn't require the overprovisioning of storage capacity to achieve performance, overspending on expensive storage media for inactive data or the overbui...
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.