Welcome!

Blog Feed Post

Bill Schmarzo’s Top 2017 Big Data, Data Science and IOT Blogs

To put us on the path for a successful and engaging 2018, here is a quick review of my top 10 blogs from 2017.

#10. Is Data Science Really Science?

Science works within systems of laws, such as the laws of physics, thermodynamics, mathematics, and many others. Scientists can apply these laws to understand why certain actions lead to certain outcomes or why something is going to occur.

While there may never be “laws” that dictate human behaviors, in the world of IOT where organizations are melding analytics (machine learning and artificial intelligence) with physical products, we will see “data science” advancing beyond just “data” science. In IOT, the data science team must expand to include scientists and engineers from the physical sciences so that the team can understand and quantify the “why things happen” aspect of the analytic models. If not, the costs could be catastrophic.

Figure 1: Scientific Method Belief and Biases

 

Note: I’m adding Figure 1 to this blog to highlight the importance of the Scientific Method and understanding basic statistical techniques to ensure that one is building their analytics on unbiased data against unbiased hypotheses.

#9. Design Thinking: Future-proof Yourself from AI

While there is a high probability that machine learning and artificial intelligence will play an important role in whatever job you hold in the future, there is one way to “future-proof” your career…embrace the power of design thinking.

Design thinking is defined as human-centric design that builds upon the deep understanding of our users (e.g., their tendencies, propensities, inclinations, behaviors) to generate ideas, build prototypes, share what you’ve made, embrace the art of failure (i.e., fail fast but learn faster) and eventually put your innovative solution out into the world.  And fortunately for us humans (who really excel at human-centric things), there is a tight correlation between the design thinking and the machine learning (see Figure 2).

Figure 2: Design Thinking and Machine Learning Mapping

#8. 5 Steps to Building a Big Data Business Strategy

“The problem is that, in many cases, big data is not used well. Companies are better at collecting data – about their customers, about their products, about competitors – than analyzing that data and designing strategy around it.” “Companies Love Big Data but Lack the Strategy to Use It Effectively,” Harvard Business Review

Build a business strategy that incorporates big data. Build a business strategy that uncovers detailed customer, product, service and operational insights serve as the foundation for optimizing key operational processes, mitigating compliance and cyber-security risks, uncover new revenue opportunities, and create a more compelling, more differentiated customer or partner experience (see Figure 3). Here my five steps for getting there.

#7. What tomorrow’s business leaders need to know about Machine Learning.

Much of what comprises “Machine Learning” is really not all new. Many of the algorithms that fall into the Machine Learning category are analytic algorithms that have been around for decades. These include  clustering, association rules, and decisions trees. However, the detailed, granularity of the data, the wide variety of data sources, and a massive increase in computing power has re-invigorated many of these mature algorithms.

Machine learning is a type of applied artificial intelligence (AI) that provides computers with the ability to gain knowledge without being explicitly programmed. Machine learning focuses on the development of computer programs that can change when exposed to new data (see Figure 4). How can businesses, and business leaders, take advantage?

Figure 4: Supervised and Unsupervised Machine Learning Algorithms

#6. Is Blockchain the Ultimate Enabler of Data Monetization?

Blockchain is a data structure that maintains a digital ledger of transactions among a distributed network of entities.  Think of a “distributed ledger” that uses cryptography to allow each participant in the transaction to add to the ledger in a secure way without the need for a central authority or central clearinghouse (see Figure 5).

Figure 5: How to Use Blockchain Technology to Retain More Customers

Is blockchain the ultimate enabler of data and analytics monetization; creating marketplaces where companies, individuals and even smart entities (cars, trucks, building, airports, malls) can share/sell/trade/barter their data and analytic insights directly with others?

The impact that has on a company’s financials could be overwhelming, or devastating, depending upon what side of business model transformation you sit.

#5. Data is a New Currency

When you insert something, a new demand, into a circular flow,you create an economic concept called the Multiplier Effect. It is a concept that countries use to consider how to invest money and how that investment, by having it distribute though a supply chain, like the example above, will impact the economy of their country.

Multiplier Effect Definition: “An effect in economics in which an increase in spending produces an increase in national income and consumption greater than the initial amount spent.”

Figure 6: Economic Multiplier Effect

 

Data exhibits a Network Effect, where data can be used at the same time across multiple use cases thereby increasing its value to the organization. I would contend that this network effect is in fact the same thing principally as the Multiplier Effect.

#4. 5 Questions that Define Your Digital Transformation

I had the opportunity in 2017 to give a 10-minute keynote at DataWorks Summit 2017.  What sort of keynote could he give in just 10 minutes?  Ten minutes is not long for a keynote, and to be honest, I too struggled with what to say.

But after some brainstorming with my marketing experts, we came up with an idea:  Pose five questions that every organization needs to consider as they prepare themselves for digital transformation.  And while I didn’t have enough time in 10 minutes to answer those questions in a keynote, I certainly did in a blog!

Figure 7: 5 Questions that Frame Your Digital Transformation

 

You can also check out a video of my DataWorks Summit keynote presentation, complete with air guitar at the end so that I could embarrass my daughter (my presentation starts around the 39:30 mark)!

#3. Can Design Thinking Unleash Organizational Innovation?

Design Thinking, or human-centered design, is all about building a deep empathy with the people you’re designing for; generating tons of ideas; building a bunch of prototypes; sharing what you’ve made with the people you’re designing for; and eventually putting your innovative new solution out in the world (see Figure 8).

Figure 8: Stanford d.school Design Thinking Process

 

There is a good reason why Stanford’s d.school does not sit within one of their existing schools. Design thinking is used in almost all of Stanford’s schools including business, computer science, electrical, mechanical, and even healthcare.  Design thinking appears to be one of the secret sauces to Stanford’s success and cultivating the entrepreneurial spirit of its students and faculty (and neighbors, in my case).

#2. The Future Is Intelligent Apps

I have seen the future!  The future is a collision between big data (and data science) and application development that will yield a world of “intelligent apps.”

These “intelligent apps” combine customer, product, and operational insights (uncovered with predictive and prescriptive analytics) with modern application development tools and user-centric design to create a more compelling, more prescriptive user experience.

Intelligent apps will support or enable key user decisions, while continually learning from the user interactions to become even more relevant and valuable to those users.

The journey to building intelligent applications starts by understanding the decisions that key business constituents need to make in supporting their business and operational objectives.

Figure 9: Intelligent Application Stack

 

And my #1 blog of 2017 (drum roll please)…

#1. Difference between Big Data and Internet of Things

What are the differences between big data and IOT analytics? Big data analyzes large amounts of mostly human-generated data to support longer-duration use cases. IOT aggregates and compresses massive amounts of low latency / low duration / high volume machine-generated data coming from a wide variety of sensors to support real-time use cases.

I don’t believe that loading sensor data into a data lake and performing data science to create predictive analytic models qualifies as doing IOT analytics.  To me, that’s just big data (and potentially REALLY BIG DATA with all that sensor data).  In order for one to claim that they can deliver IOT analytic solutions requires big data (with data science and a data lake), but IOT analytics must also include:

  • Streaming data management with the ability to ingest, aggregate (e.g., mean, median, mode), and compress real-time data coming off a wide variety of sensor devices “at the edge” of the network.
  • Edge analytics that automatically analyzes real-time sensor data and renders real-time decisions (actions) at the edge of the network that optimizes operational performance (blade angle or yaw), or flags unusual performance or behaviors for immediate investigation (security breaches, fraud detection).

Sources:

Figure 1: Scientific Method Beliefs and Biases

Figure 4: Supervised and Unsupervised Machine Learning Algorithms

Figure 5: How to Use Blockchain Technology to Retain More Customers

 

The post Bill Schmarzo’s Top 2017 Big Data, Data Science and IOT Blogs appeared first on InFocus Blog | Dell EMC Services.

Read the original blog entry...

More Stories By William Schmarzo

Bill Schmarzo, author of “Big Data: Understanding How Data Powers Big Business” and “Big Data MBA: Driving Business Strategies with Data Science”, is responsible for setting strategy and defining the Big Data service offerings for Hitachi Vantara as CTO, IoT and Analytics.

Previously, as a CTO within Dell EMC’s 2,000+ person consulting organization, he works with organizations to identify where and how to start their big data journeys. He’s written white papers, is an avid blogger and is a frequent speaker on the use of Big Data and data science to power an organization’s key business initiatives. He is a University of San Francisco School of Management (SOM) Executive Fellow where he teaches the “Big Data MBA” course. Bill also just completed a research paper on “Determining The Economic Value of Data”. Onalytica recently ranked Bill as #4 Big Data Influencer worldwide.

Bill has over three decades of experience in data warehousing, BI and analytics. Bill authored the Vision Workshop methodology that links an organization’s strategic business initiatives with their supporting data and analytic requirements. Bill serves on the City of San Jose’s Technology Innovation Board, and on the faculties of The Data Warehouse Institute and Strata.

Previously, Bill was vice president of Analytics at Yahoo where he was responsible for the development of Yahoo’s Advertiser and Website analytics products, including the delivery of “actionable insights” through a holistic user experience. Before that, Bill oversaw the Analytic Applications business unit at Business Objects, including the development, marketing and sales of their industry-defining analytic applications.

Bill holds a Masters Business Administration from University of Iowa and a Bachelor of Science degree in Mathematics, Computer Science and Business Administration from Coe College.

Latest Stories
Whenever a new technology hits the high points of hype, everyone starts talking about it like it will solve all their business problems. Blockchain is one of those technologies. According to Gartner's latest report on the hype cycle of emerging technologies, blockchain has just passed the peak of their hype cycle curve. If you read the news articles about it, one would think it has taken over the technology world. No disruptive technology is without its challenges and potential impediments t...
Hackers took three days to identify and exploit a known vulnerability in Equifax’s web applications. I will share new data that reveals why three days (at most) is the new normal for DevSecOps teams to move new business /security requirements from design into production. This session aims to enlighten DevOps teams, security and development professionals by sharing results from the 4th annual State of the Software Supply Chain Report -- a blend of public and proprietary data with expert researc...
Lori MacVittie is a subject matter expert on emerging technology responsible for outbound evangelism across F5's entire product suite. MacVittie has extensive development and technical architecture experience in both high-tech and enterprise organizations, in addition to network and systems administration expertise. Prior to joining F5, MacVittie was an award-winning technology editor at Network Computing Magazine where she evaluated and tested application-focused technologies including app secu...
DXWorldEXPO LLC announced today that Nutanix has been named "Platinum Sponsor" of CloudEXPO | DevOpsSUMMIT | DXWorldEXPO New York, which will take place November 12-13, 2018 in New York City. Nutanix makes infrastructure invisible, elevating IT to focus on the applications and services that power their business. The Nutanix Enterprise Cloud Platform blends web-scale engineering and consumer-grade design to natively converge server, storage, virtualization and networking into a resilient, softwar...
DXWorldEXPO LLC announced today that Big Data Federation to Exhibit at the 22nd International CloudEXPO, colocated with DevOpsSUMMIT and DXWorldEXPO, November 12-13, 2018 in New York City. Big Data Federation, Inc. develops and applies artificial intelligence to predict financial and economic events that matter. The company uncovers patterns and precise drivers of performance and outcomes with the aid of machine-learning algorithms, big data, and fundamental analysis. Their products are deployed...
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence. Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more busine...
Having been in the web hosting industry since 2002, dhosting has gained a great deal of experience while working on a wide range of projects. This experience has enabled the company to develop our amazing new product, which they are now excited to present! Among dHosting's greatest achievements, they can include the development of their own hosting panel, the building of their fully redundant server system, and the creation of dhHosting's unique product, Dynamic Edge.
This session will provide an introduction to Cloud driven quality and transformation and highlight the key features that comprise it. A perspective on the cloud transformation lifecycle, transformation levers, and transformation framework will be shared. At Cognizant, we have developed a transformation strategy to enable the migration of business critical workloads to cloud environments. The strategy encompasses a set of transformation levers across the cloud transformation lifecycle to enhance ...
Your job is mostly boring. Many of the IT operations tasks you perform on a day-to-day basis are repetitive and dull. Utilizing automation can improve your work life, automating away the drudgery and embracing the passion for technology that got you started in the first place. In this presentation, I'll talk about what automation is, and how to approach implementing it in the context of IT Operations. Ned will discuss keys to success in the long term and include practical real-world examples. Ge...
The challenges of aggregating data from consumer-oriented devices, such as wearable technologies and smart thermostats, are fairly well-understood. However, there are a new set of challenges for IoT devices that generate megabytes or gigabytes of data per second. Certainly, the infrastructure will have to change, as those volumes of data will likely overwhelm the available bandwidth for aggregating the data into a central repository. Ochandarena discusses a whole new way to think about your next...
So the dumpster is on fire. Again. The site's down. Your boss's face is an ever-deepening purple. And you begin debating whether you should join the #incident channel or call an ambulance to deal with his impending stroke. Yes, we know this is a developer's fault. There's plenty of time for blame later. Postmortems have a macabre name because they were once intended to be Viking-like funerals for someone's job. But we're civilized now. Sort of. So we call them post-incident reviews. Fires are ne...
CloudEXPO New York 2018, colocated with DevOpsSUMMIT and DXWorldEXPO New York 2018 will be held November 12-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI and Machine Learning to one location.
CloudEXPO | DevOpsSUMMIT | DXWorldEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
The digital transformation is real! To adapt, IT professionals need to transform their own skillset to become more multi-dimensional by gaining both depth and breadth of a wide variety of knowledge and competencies. Historically, while IT has been built on a foundation of specialty (or "I" shaped) silos, the DevOps principle of "shifting left" is opening up opportunities for developers, operational staff, security and others to grow their skills portfolio, advance their careers and become "T"-sh...
ICC is a computer systems integrator and server manufacturing company focused on developing products and product appliances to meet a wide range of computational needs for many industries. Their solutions provide benefits across many environments, such as datacenter deployment, HPC, workstations, storage networks and standalone server installations. ICC has been in business for over 23 years and their phenomenal range of clients include multinational corporations, universities, and small busines...