Contrary to the prevailing sentiments, I counsel patience with regards to hiring a data scientist. Firstly, I mean no disrespect to my data science colleagues, and many will likely agree with me because no one likes to enter an environment where sub-optimal results or failure are probable. Yes, it’s likely you need to add one or even a few data scientists to the team, but not as your first step into the wide, wide world of Big Data. Give me a few minutes and hopefully you’ll see it my way.
Sure, Big Data is, well big. And it’s scary. Especially to those of you who have not been around large data sets most of your lives. So you need help understanding it. To put the problem in perspective let’s look at a medical analogy. If you have some discomfort in your chest, you don’t run to a cardiac surgeon and ask for bypass surgery. First you try to understand the nature of the problem and then go through protocols designed to make the discomfort go away. Even in the case of extreme circumstances, one goes through a diagnostic process, perhaps in an emergency room, to determine the best way to get “better”. I would submit that if your business situation is extreme with respect to Big Data, there are probably bigger issues to deal with and you might need a different kind of specialist. A lot is going to depend on the size of your company or organization. If you are a medium to large global enterprise with lots of consumer-type customers the need for Big Data usage may be more acute than in smaller companies, and at some point you may find that you need data science expertise in house. Smaller companies need to think very hard about on staff data scientists as the costs may outweigh the benefits. In either case hiring decisions should follow strategy, planning, budgeting, etc. Knowing what you need to do ahead of time will help to frame implementation decisions down the road, including and especially hiring.
What if you don’t know enough to craft a strategy? In all fairness a data science perspective will be important in any well-conceived strategy or plan. Hire some consultants. (I know this seems self serving, but the right consultant will work themselves out of a job. Others, not so much.) The short term expense will be amortized many times over as you march down the road towards extracting maximum value from your Big Data investments. Not every consulting firm will have the expertise necessary, although many will profess they do. Like many other decisions we make: buyer beware. Network with colleagues, attend some industry conferences, find the right short term help and the rest will fall into place. When the time is right to hire, hold on to your chairs. According to the media, it looks like data scientists may be getting paid better than cardiac surgeons, so don’t expect to get any bargains.
There really isn’t any need to panic hire. Big Data is here to stay. If we have proven anything it’s that as an industry we are insatiable when it comes to capacity, speed, bandwidth consumption, etc. That means you have time to strategize and plan about how to make the most effective use of the Big Data that matters to you. Remember the old saw: proper planning prevents poor performance. Never has it been truer than with Big Data.