Blog Feed Post

Messy Desks Are Perfectly Optimized

While I was out at a meeting, my meticulously neat wife armed herself with a feather duster, donned protective pink rubber gloves, and viciously, mercilessly straightened, organized, and dusted the desk in my home office. My desk was clean, but the results were suboptimal.

Everyone is talking about data and how valuable it is. But do you know the names and functions of the most basic algorithms being used to turn data into action? Have you brushed up on your math skills and started to think about how data will flow through the systems you are asking your engineers to create?

As it has taken me less than a day to re–mess up my desk, I thought it would be fun to talk about some of the algorithms we use every day that are also used by computer scientists, data scientists, AI, and machine learning systems.

Insertion Sort

My wife unknowingly used an algorithm to sort my papers. She sorted the papers alphabetically by arranging them one by one in their appropriate position. This technique is called Insertion Sort, and while it is intuitive, the time spent sorting increases exponentially (aka quadratic time). It gets worse. After she sorted the documents, she grouped them by letter and put each group into corresponding hanging folders in my desk file drawer. Her choice to insertion sort the data on my desk (and then store the data alphabetically) did nothing to speed my access to the data or help me efficiently find the data I’m most likely to need next.

An Aesthetic Triumph, but a Predictive Disaster

While my desk was devoid of paper, was dust free, and looked great, all of my papers were now tucked away in a file drawer organized for first-letter alphabetic search. There was no respect or attention paid to frequency of the data usage or temporal constraints (such as an invoice with a due date). Sorting data by an arbitrary criterion may satisfy your aesthetic sensibility, but it may make no sense in a data-driven world.

Self-Organizing Lists

In practice, there is a caching algorithm that is currently thought to be the very best at predicting your future data access needs. And my messy desk is a great example. The algorithm is known as LRU (Least Recently Used). This optimization algorithm is based on the idea that the papers you most recently used are the ones you are most likely to use again. Conversely, the papers you have not used in a long time will probably remain unused.

So the optimal way to deal with papers on your desk is to put the paper you just finished working with on the top of the pile. If you follow this algorithm (which requires no thought at all), the math says the maximum time you will spend searching for anything in the pile will never be more than twice the time you would have spent if you were clairvoyant. Messy desks are perfectly optimized.

Stupid Time

If you need a practical test (if you don’t trust the math), time how long it takes to find something you did yesterday in the pile of papers in front of you. I would be surprised if it was more than a few seconds.

Now, try to find the same thing (with the same search criteria) in the file folder system. It will likely take much longer. Plus, unlike the cache in your messy pile, searching the folders will require you to remember the name of the vendor or title of the paper. Importantly, even if searching the alphabetic folders takes the same amount of time as searching the pile on your desk (which it won’t), you have to add back the hours spent organizing the files (doing meta-work) for no purpose at all.

Messy Is Awesome!

So the next time someone walks into your office and politely inquires, “How can you find anything in this mess?” you can tell them that your desk is perfectly optimized for temporal search and is an example of the best predictive model known in current mathematics.

Author’s note: This is not a sponsored post. I am the author of this article and it expresses my own opinions. I am not, nor is my company, receiving compensation for it.

Other Articles You May Enjoy

iPhone X Review

What #MeToo Is Teaching AI

Will Congress Kill Facebook and the Rest of the Internet?

Why Lose-Lose Is Almost Always A Winning Strategy

Who Should Be The President of the Internet?

Chipping People: Are You Ready?

ICOs: What You Need to Know

How Do You See the Future?

The post Messy Desks Are Perfectly Optimized originally appeared here on Shelly Palmer

Read the original blog entry...

More Stories By Shelly Palmer

Shelly Palmer is the host of Fox Television’s "Shelly Palmer Digital Living" television show about living and working in a digital world. He is Fox 5′s (WNYW-TV New York) Tech Expert and the host of United Stations Radio Network’s, MediaBytes, a daily syndicated radio report that features insightful commentary and a unique insiders take on the biggest stories in technology, media, and entertainment.

Latest Stories
"Infoblox does DNS, DHCP and IP address management for not only enterprise networks but cloud networks as well. Customers are looking for a single platform that can extend not only in their private enterprise environment but private cloud, public cloud, tracking all the IP space and everything that is going on in that environment," explained Steve Salo, Principal Systems Engineer at Infoblox, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventio...
"Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
The question before companies today is not whether to become intelligent, it’s a question of how and how fast. The key is to adopt and deploy an intelligent application strategy while simultaneously preparing to scale that intelligence. In her session at 21st Cloud Expo, Sangeeta Chakraborty, Chief Customer Officer at Ayasdi, provided a tactical framework to become a truly intelligent enterprise, including how to identify the right applications for AI, how to build a Center of Excellence to oper...
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
In his session at 21st Cloud Expo, James Henry, Co-CEO/CTO of Calgary Scientific Inc., introduced you to the challenges, solutions and benefits of training AI systems to solve visual problems with an emphasis on improving AIs with continuous training in the field. He explored applications in several industries and discussed technologies that allow the deployment of advanced visualization solutions to the cloud.
Widespread fragmentation is stalling the growth of the IIoT and making it difficult for partners to work together. The number of software platforms, apps, hardware and connectivity standards is creating paralysis among businesses that are afraid of being locked into a solution. EdgeX Foundry is unifying the community around a common IoT edge framework and an ecosystem of interoperable components.
Agile has finally jumped the technology shark, expanding outside the software world. Enterprises are now increasingly adopting Agile practices across their organizations in order to successfully navigate the disruptive waters that threaten to drown them. In our quest for establishing change as a core competency in our organizations, this business-centric notion of Agile is an essential component of Agile Digital Transformation. In the years since the publication of the Agile Manifesto, the conn...
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Large industrial manufacturing organizations are adopting the agile principles of cloud software companies. The industrial manufacturing development process has not scaled over time. Now that design CAD teams are geographically distributed, centralizing their work is key. With large multi-gigabyte projects, outdated tools have stifled industrial team agility, time-to-market milestones, and impacted P&L stakeholders.
"ZeroStack is a startup in Silicon Valley. We're solving a very interesting problem around bringing public cloud convenience with private cloud control for enterprises and mid-size companies," explained Kamesh Pemmaraju, VP of Product Management at ZeroStack, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Enterprises are adopting Kubernetes to accelerate the development and the delivery of cloud-native applications. However, sharing a Kubernetes cluster between members of the same team can be challenging. And, sharing clusters across multiple teams is even harder. Kubernetes offers several constructs to help implement segmentation and isolation. However, these primitives can be complex to understand and apply. As a result, it’s becoming common for enterprises to end up with several clusters. Thi...
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Akvelon is a software development company and we also provide consultancy services to folks who are looking to scale or accelerate their engineering roadmaps," explained Jeremiah Mothersell, Marketing Manager at Akvelon, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.