As a data scientist, I have helped business analysts write Oracle queries in batch mode run 20 times faster via Perl/Python scripts: instead of waiting for hours for Brio or Toad to return results in a browser (with a crash if the number of rows being returned was above 50,000), it took only minutes on a Unix station: I also spent 30 minutes providing basic Unix training to analysts so they could run and fix my Perl scripts alone. It was a win-win-win: for the business analyst, for executive management, and for myself.
One thing that helped a lot is the fact that my scripts would accept (as input) a SQL query (text file - something business analysts could easily and quickly produce with Brio or Toad and then export to the Unix station) and produced as output the results of the query (tab-separated text file) and another file about the success/failure of the query (with explanations as why the query failed, if it did, to help fix bugs in the SQL code). This made the life of the business analyst very easy. I also taught them about 20 important Unix/FTP commands that could solve all their Unix needs.
I have been deeply involved (as a data scientist) in helping design efficient dashboards as well as selecting which metrics or KPI's should be tracked in database systems, including data modeling. Currently many people believe this is the job of a business analyst or executive, but don't you think that data scientists should be deeply involved in data modeling, vendor selection and everything related to data harvesting and storing?
What do you think?
Anyway, feel free to download the magic code to boost BI analysts work by a factor 20.
I completely agree. There's the IT-side that does what the business tells them and the business-side that does not really know how to translate business into data. The data scientist / data analyst is the middle-person that understands how to turn data into value and work/communicate on both sides.
Vincent, All Data Scientist would require to be business analysts in domains that they work in while all business analysts may not be data scientists in the short term and in the long term the business analyst would pretty much fade with time.
I think their relation is like data base architect and network architect. While their work overlaps, they are specialist in their own area and probaly won't enjoy doing everything else the other one is doing.
A Business Analyst is more of a functional role. Whereas a Data Scientist is more like “The-All-Seeing-Eye”. The Data Scientist will always follow/create/verify the logic that is necessary. The Data Scientist will clarify and authenticate the requests from the Business Analyst. Not all Data Scientist will function in this role because this is not their main focus. The Data Scientist will be more heavily concentrated in the integrity of the structure, processing, speed of delivery. So, this is just my opinion, I think they will be more focused with the system side – machine learning, database- DBAs, data warehousing, and maybe a little help with the application developers. However, a data scientist is not a application developer or a frontend BI designer. Data Scientist will be the master mind of answering the question, "How do we put all this data together in a meaningful way so we can examine it”? They create the matrices.