The quest for a useful definition\n---------------------------------\n\nBehold my pithiest attempt: “**Data science is the discipline of making data useful**.” Feel free to flee now or stick around of a tour of its three subfields.\n\n* [Statistics](http://bit.ly/quaesita_statistics)\n* [Machine learning](http://bit.ly/quaesita_simplest)\n* [Data-mining / analytics](http://bit.ly/quaesita_analysts)\n\n#### The term no one really defined\n\nIf you poke around in the early [history](https://www.forbes.com/sites/gilpress/2013/05/28/a-very-short-history-of-data-science/#6b64132f55cf) of the term **data science**, you see two themes coming together. Allow me to paraphrase for your amusement:\n\n* Big(ger) data means more tinkering with computers.\n* [Statisticians](http://bit.ly/quaesita_statistics) can’t code their way out of a paper bag.\n\nAnd thus, data science is born. The way I first heard the job defined is “A **data scientist** is a **statistician** who can code.” I’ll be full of opinions on that [in a moment](http://bit.ly/quaesita_bubble), but first, why don’t we examine data science itself?\n\n!(https://hackernoon.com/hn-images/1*NcQRRnvZdcqbnN0lm99k2w.png)\n\n[Twitter definitions](https://twitter.com/cdixon/status/428914681911070720) circa 2014.\n\nI love how the 2003 launch of [_Journal of Data Science_](http://www.jds-online.com/) goes right for the narrowest possible scope: _“By ‘Data Science’ we mean almost_ **_everything_** _that has something to do with data.”_ So… everything, then? It’s hard to think of something that has nothing to do with information. (I should stop thinking about this before my head explodes.)\n\nSince then, we’ve seen a multitude of opinions, from Conway’s well-traveled Venn diagram (_below_) to Mason and Wiggins’ [classic post](http://www.dataists.com/2010/09/a-taxonomy-of-data-science/).\n\n!(https://hackernoon.com/hn-images/0*Vv3ODEuDmp7bDkyu.jpg)\n\n[Drew Conway](http://drewconway.com/)’s definition of data science. My personal taste runs more towards the definition on [Wikipedia](https://en.wikipedia.org/wiki/Data_science).\n\n**Wikipedia** has one that’s very close to what I teach my students:\n\n_Data science is a ‘concept to unify statistics, data analysis, machine learning and their related methods’ in order to ‘understand and analyze actual phenomena’ with data._\n\nThat’s a mouthful, so let me see if I can make it short and sweet:\n\n> “Data science is the discipline of making data useful.”\n\nWhat you’re thinking around about now might be, _“Nice try, Cassie. It’s cute, but it’s an egregiously lossy reduction. How does the word ‘useful’ capture all of that jargon stuff?”_\n\nWell, okay, let’s argue it out with pictures.\n\n!(https://hackernoon.com/hn-images/1*1agVRJ_7_HwrKW81jQamwQ.png)\n\nHere’s a map for data science for you, perfectly faithful to the [Wikipedia](https://en.wikipedia.org/wiki/Data_science) definition.\n\nWhat are these things and how do you know where you are on the map?\n\nIf you’re about try breaking them down by **standard toolkits**, slow down. The difference between a statistician and a machine learning engineer is not that one uses R and the other uses Python. The SQL vs R vs Python taxonomy is ill-advised for so many reasons, not least of which is that software evolves. (As of recently, you can even do [ML in SQL](https://cloud.google.com/bigquery/docs/bigqueryml-intro).) Wouldn’t you prefer a breakdown that’ll last? In fact, just go ahead and unread this entire paragraph.\n\nPerhaps worse is the favorite way novices split the space. Yup, you guessed it: by the **algorithm** (surprise! it’s how university courses are structured). Pretty please, don’t taxonomize by histograms vs t-tests vs neural networks. Frankly, if you’re clever and you have a point to make, you can use the same algorithm for any part of data science. It might look like Frankenstein’s monster, but I assure you it can be forced to do your bidding.\n\nEnough with the dramatic buildup! Here’s the taxonomy I propose:\n\n!(https://hackernoon.com/hn-images/1*TilIsSqBjH-QlYs4valU4Q.png)\n\n#### None-One-Many\n\nWhat on earth is this? Why, decisions, of course! (Under _incomplete information_. When all the facts you need are visible to you, you can use descriptive analytics for making as many decisions as you please. Just look at the facts and you’re done.)\n\n> It’s through our actions — our decisions — that we affect the world around us.\n\nI’d promised you we were going to talk about making data useful. To me, the idea of usefulness is tightly coupled with influencing real-world actions. If I believe in Santa Claus, it doesn’t particularly matter unless it might influence my behavior in some way. Then, depending on the potential consequences of that behavior, it might start to matter an awful lot. It’s through our actions — our decisions — that we affect the world around us (and invite it to affect us right back).\n\nSo here’s the new decision-oriented picture for you, complete with the three main ways to make your data useful.\n\n!(https://hackernoon.com/hn-images/1*8Wz6lQ8GFEAvnSS5uqMQ5g.png)\n\n#### Data-mining / Analytics\n\nIf you don’t know what decisions you want to make yet, the best you can do is go out there in search of inspiration. That’s called data-mining or [analytics](http://bit.ly/quaesita_analysts) or descriptive analytics or exploratory data analysis (EDA) or knowledge discovery (KD), depending on which crowd you hung out with during your impressionable years.\n\n> Golden rule of analytics: only make conclusions about what you can see.\n\nUnless you know how you intend to frame your decision-making, start here. The great news is that this one is easy. Think of your dataset as a bunch of negatives you found in a darkroom. Data-mining is about working the equipment to expose all the images as quickly as possible so you can see whether there’s anything inspiring on them. As with photos, remember not to take what you see too seriously. You didn’t take the photos, so you don’t know much about what’s off-screen. The golden rule of data-mining is: **stick to what is here.** Only make conclusions about what you can see, never about what you can’t see (for that you need statistics and lot more expertise).\n\nOther than that, you can do no wrong. Speed wins, so start practicing.\n\n> Expertise in data-mining is judged by the speed with which you can examine your data. It helps not to snooze past the interesting nuggets.\n\nThe darkroom’s intimidating at first, but there’s not that much to it. Just learn to work the equipment. Here’s a tutorial in [R](https://www.datacamp.com/community/tutorials/tidyverse-tutorial-r) and here’s one in [Python](https://www.datacamp.com/community/tutorials/kaggle-machine-learning-eda) to get you started. You can call yourself a data analyst as soon as you start having fun and you can call yourself an expert analyst when you’re able to expose photos (and all the other kinds of datasets) with lightning speed.\n\n!(https://hackernoon.com/hn-images/1*4GUMSExOCXaL06tG0Ip83g.png)\n\n#### Statistical inference\n\nInspiration is cheap, but rigor is expensive. If you want to leap beyond the data, you’re going to need specialist training. As someone with undergrad _and_ graduate majors in statistics, I may be just a tad biased here, but in my opinion statistical inference (statistics for short) is the most difficult and philosophy-laden of the three areas. Getting good at it takes the most time.\n\n> Inspiration is cheap, but rigor is expensive.\n\nIf you intend to make high-quality, risk-controlled, important decisions that rely on conclusions about the world beyond the data available to you, you’re going to have to bring statistical skills onto your team. A great example is that moment when your finger is hovering over the launch button for an AI system and it occurs to you that you need to check it works before releasing it (always a good idea, seriously). Step away from the button and call in the statistician.\n\n> Statistics is the science of changing your mind (under uncertainty).\n\nIf you want to learn more, I’ve written [this 8-minute super-summary of statistics](http://bit.ly/quaesita_statistics) for your enjoyment.\n\n#### Machine learning\n\nMachine learning is essentially [making thing-labeling recipes using examples instead of instructions](http://bit.ly/quaesita_simplest). I’ve written a few posts about it, including whether it’s [different from AI,](http://bit.ly/quaesita_ai) how to [get started](http://bit.ly/quaesita_dmguide) with it, [why businesses fail at it](http://bit.ly/quaesita_fail), and the first couple of articles in a series of plain-language takes on the jargon nitty gritties ([start here](http://bit.ly/quaesita_slkid)). Oh, and if you want to share them with non-English-speaking friends, a bunch of them are translated [here](https://medium.com/@kozyr_91350/).\n\n!(https://hackernoon.com/hn-images/0*hhHRjIyPDYa3fois.jpg)\n\n#### **Data engineering**\n\nWhat about [**data engineering**](https://www.dataquest.io/blog/what-is-a-data-engineer/), the work that delivers data to the data science team in the first place? Since it’s a sophisticated field in its own right, I prefer to shield it from data science’s hegemonic aspirations. Besides, it’s much closer in species to software engineering than to statistics.\n\n> The difference between data engineering and data science is a difference of before and after.\n\nFeel free to see the **data engineering versus data science** difference as **before versus after**. Most of the technical work leading up to the birthing of the data (before) may comfortably be called “data engineering” and everything we do once some data have arrived (after) is “data science”.\n\n#### Decision intelligence\n\n[DI is all about decisions](https://www.youtube.com/watch?v=x1k37Na1iLc), including decision-making at scale with data, which makes it an engineering discipline. It augments the applied aspects of data science with ideas from the social and managerial sciences.\n\n> Decision intelligence adds components from the social and managerial sciences.\n\nIn other words, it’s a superset of those bits of data science not concerned with researchy things like creating fundamental methodologies for general-purpose use.\n\nStill hungry? [Here’s a breakdown of the roles in a data science project](http://bit.ly/quaesita_roles) to entertain you while I go clack on my keyboard.