William Vorhies's Blog – September 2017 Archive (4)

Deep Diving the Data Lake – Automatically Determining What’s In There

Summary: As your data lake grows larger and your user group more diverse you will need these tools that automatically catalog data and control access to your information. They are a huge benefit and only enhance the spirit of free exploration of data for new value.

Data Lakes have been around almost as long as we’ve had Big Data. That…

Continue

Added by William Vorhies on September 26, 2017 at 9:32am — No Comments

AI’s Ethical Dilemma – An Unexpectedly Urgent Problem

Summary: In just the last 10 months based only on facial characteristics deep learning has been used to predict who is a criminal and who is gay. These are rigorous, peer reviewed studies published in academic journals. How should this knowledge be used and how will the public react?

Were you as freaked out as I was when earlier this…

Continue

Added by William Vorhies on September 19, 2017 at 7:00am — 4 Comments

Regulating AI – The Road Ahead

Summary: With only slight tongue in cheek about the road ahead we report on the just passed House of Representative’s new “Federal Automated Vehicle Policy” as well as similar policy just emerging in Germany. As a model of regulation on emerging AI technology we think they got this just about right.

Just today (9/6/17) the US…

Continue

Added by William Vorhies on September 12, 2017 at 9:35am — No Comments

Dealing With Imbalanced Datasets

Summary: Dealing with imbalanced datasets is an everyday problem. SMOTE, Synthetic Minority Oversampling TEchnique and its variants are techniques for solving this problem through oversampling that have recently become a very popular way to improve model performance.