Talent Shortage Looms Over Big Data - WSJ.com


43 bookmarks. First posted by jranck april 2012.


Big Data's Big Problem: Little Talent... http://t.co/NC4CdiGm
Archive 
april 2014 by fields
April 29, 2012 | WSJ | By BEN ROONEY

Big Data's Big Problem: Little Talent

"A significant constraint on realizing value from Big Data will be a shortage of talent, particularly of people with deep expertise in statistics and machine learning, and the managers and analysts who know how to operate companies by using insights from Big Data," the report said. "We project a need for 1.5 million additional managers and analysts in the United States who can ask the right questions and consume the results of the analysis of Big Data effectively." What the industry needs is a new type of person: the data scientist.....Hilary Mason, chief scientist for the URL shortening service bit.ly, says a data scientist must have three key skills. "They can take a data set and model it mathematically and understand the math required to build those models; they can actually do that, which means they have the engineering skills…and finally they are someone who can find insights and tell stories from their data. That means asking the right questions, and that is usually the hardest piece."

It is this ability to turn data into information into action that presents the most challenges. It requires a deep understanding of the business to know the questions to ask. The problem that a lot of companies face is that they don't know what they don't know, as former U.S. Defense Secretary Donald Rumsfeld would say. The job of the data scientist isn't simply to uncover lost nuggets, but discover new ones and more importantly, turn them into actions. Providing ever-larger screeds of information doesn't help anyone.

One of the earliest tests for biggish data was applying it to the battlefield. The Pentagon ran a number of field exercises of its Force XXI—a device that allows commanders to track forces on the battlefield—around the turn of the century. The hope was that giving generals "exquisite situational awareness" (i.e. knowing everything about everyone on the battlefield) would turn the art of warfare into a science. What they found was that just giving bad generals more information didn't make them good generals; they were still bad generals, just better informed.

"People have been doing data mining for years, but that was on the premise that the data was quite well behaved and lived in big relational databases," said Mr. Shadbolt. "How do you deal with data sets that might be very ragged, unreliable, with missing data?"

In the meantime, companies will have to be largely self-taught, said Nick Halstead, CEO of DataSift, one of the U.K. start-ups actually doing Big Data. When recruiting, he said that the ability to ask questions about the data is the key, not mathematical prowess. "You have to be confident at the math, but one of our top people used to be an architect".
data_scientists  massive_data_sets  talent_management  talent  limitations  situational_awareness  questions  Donald_Rumsfeld  Pentagon  shortages  McKinsey  war_for_talent  recruiting  Colleges_&_Universities 
june 2012 by jerryking
"A significant constraint on realizing value from Big Data will be a shortage of talent, particularly of people with deep expertise in statistics and machine learning, and the managers and analysts who know how to operate companies by using insights from Big Data," the report said. "We project a need for 1.5 million additional managers and analysts in the United States who can ask the right questions and consume the results of the analysis of Big Data effectively." What the industry needs is a new type of person: the data scientist.
business  career  data  datascience  bigdata 
may 2012 by avinash
One of the earliest tests for biggish data was applying it to the battlefield. The Pentagon ran a number of field exercises of its Force XXI—a device that allows commanders to track forces on the battlefield—around the turn of the century. The hope was that giving generals "exquisite situational awareness" (i.e. knowing everything about everyone on the battlefield) would turn the art of warfare into a science. What they found was that just giving bad generals more information didn't make them good generals; they were still bad generals, just better informed.
bigdata  from delicious
may 2012 by sordyl
Hilary Mason, chief scientist for the URL shortening service bit.ly, says a data scientist must have three key skills. "They can take a data set and model it mathematically and understand the math required to build those models; they can actually do that, which means they have the engineering skills…and finally they are someone who can find insights and tell stories from their data. That means asking the right questions, and that is usually the hardest piece."
may 2012 by gggg
"job of the data scientist isn't simply to uncover lost nuggets, but discover … & turn them into actions"
from twitter
april 2012 by wtd
It seems that the markets are as much in love with "Big Data"—the ability to acquire, process and sort vast quantities of data in real time—as the technology industry.
bigdata 
april 2012 by tguemes
Big Data's Big Problem: Little Talent http://t.co/7groLocm
via:packrati.us 
april 2012 by doughamlin
HP's says algorithms mitigate Big Data's talent shortage. If so, good for cos like
ML  from twitter
april 2012 by phil_hendrix
OMG, Big data needs sociological theory to make sense of it. Who would have thunk it?
from twitter_favs
april 2012 by wlanderson
Big Data's Big Problem: Little Talent ()
Archive  from twitter_favs
april 2012 by ngpestelos
Big Data's Big Problem: Little Talent
from twitter
april 2012 by tnorthcutt
"A significant constraint on realizing value from Big Data will be a shortage of talent, particularly of people with deep expertise in statistics and machine learning, and the managers and analysts who know how to operate companies by using insights from Big Data," the report said. "We project a need for 1.5 million additional managers and analysts in the United States who can ask the right questions and consume the results of the analysis of Big Data effectively." What the industry needs is a new type of person: the data scientist.
business  data  bigdata  career  jobs 
april 2012 by andrewedunn
It seems that the markets are as much in love with "Big Data"—the ability to acquire, process and sort vast quantities of data in real time—as the technology industry. Hilary Mason,…
from readability
april 2012 by DASKAjA
Talent Shortage Looms Over Big Data - http://t.co/SLUmUKI0 http://t.co/Wzgciasm
via:packrati.us 
april 2012 by bytebot
Big Data's Big Problem: Little Talent
from twitter_favs
april 2012 by brian_frank
RT @myoung: WSJ article, starring @hmason, on the lack of data scientists: Big Data's Big Problem: Little Talent http://t.co/2rsNaox1
april 2012 by duswain
RT : WSJ article, starring , on the lack of data scientists: Big Data's Big Problem: Little Talent
from twitter
april 2012 by MacDiva
WSJ article, starring , on the lack of data scientists: Big Data's Big Problem: Little Talent
from twitter_favs
april 2012 by cpdis
WSJ article, starring , on the lack of data scientists: Big Data's Big Problem: Little Talent
from twitter_favs
april 2012 by drjlearning