Contributed by Ben Townson. He enrolled in the NYC Data Science Academy 12-week full time Data Science Bootcamp program taking place between July 5th to September 23rd, 2016. This post is based on their third project - Web Scraping, due on 6th week of the program. 

Background In 2016, the PGA Tour, the leading professional golf tour in the world, began using an upgraded version of the Strokes-Gained methodology pioneered by Mark broadie as the…

Contributed by David Richard Steinmetz. He enrolled in the NYC Data Science Academy 12-week full time Data Science Bootcamp program taking place between July 5th to September 23rd, 2016. This post is based on their second project - R Shiny, due on 4th week of the program. The original article can be found here.

Automated driving is coming, and it will affect you…

Contributed by Ben Townson. He enrolled in the NYC Data Science Academy 12-week full time Data Science Bootcamp program taking place between July 5th to September 23rd, 2016. This post is based on their second project - R Shiny, due on 4th week of the program. The original article can be found…

Contributed by Dina Mirijanian. 

Chronic diseases, such as heart disease, cancer and diabetes are among the most common and costly health problems. According to the Center of Disease Control and Prevention (CDC), “half of all American adults have at least one chronic condition and almost one of three have multiple chronic conditions”. Apart from the cost burden, heart disease and cancer are the top one and two causes of death in the country. While, diabetes ranks a…

Step 0: Should I try to Scrape this?

So you're excited about a great idea, you've found a great site that looks easy to scrape, time to jump right in and start writing a scraper, right?

STOP!

First things first, it's crucial to examine the data you wish to scrape. Is it well organized? Will it be difficult to clean later? Sentences can be notoriously hard to clean, because sentences have to be parsed somehow to extract…

Contributed by http://blog.nycdatascience.com/author/sjstebbins/","Spencer";)">Spencer James Stebbins. He enrolled in the NYC Data Science Academy 12-week full time Data Science Bootcamp program taking place between July 5th to September 23rd, 2016. This post is based on their third…

Introduction

Almost everyone loves to spend their leisure time to watch movies with their family and friends. We all have the same experience when we sit on our couch to choose a movie that we are going to watch and spend the next two hours but can't even find one after 20 minutes. It is so disappointing. We definitely need a computer agent to provide movie recommendation to us when we need to…

Contributed by David Letzler. 

Introduction: A Brief History and Description of the Common Core

In 2009 the National Governors’ Association and the Council of Chief State School Officers resolved to develop a set of national education standards known as the Common Core. These were intended to unify what had been to that point a set of highly localized state education standards.  The hope of the Common Core was that a…

Contributed by Evan Frisch. 

GitHub hosts over 84 million repositories, a number that continues to grow rapidly. Software developers must consider a number of important factors as they decide whether to use -- or contribute to -- a project hosted on the site. GitHub Profiler provides a number of indicators that can help with such decisions. With the wealth of public repositories it hosts, GitHub often makes it easy to find many libraries that…

Contributed by David Letzler, Kyle Gallatin and Christopher Capozzola They…

Contributed by Thomas Kassel. He enrolled in the NYC Data Science Academy 17-week remote bootcamp program, taking place from January to April 2017. This post is based on his third class project focusing on web scraping in Python. The original article can be found…

Contributed by Yisong Tao. 

Anime, the abbreviated pronunciation of "animation" in Japanese, refers to animation from Japan. Its style is often characterized by colorful graphics, vibrant characters, and fantastical themes As someone who watched lots of anime growing up, I turned my sight to the largest anime and manga database and community - MyAnimeList.net.

Web Scraping:

The website is…

Contributed by Yisong Tao. 

Choosing a high school is one of the first big decisions in life. With over 400 public high schools in New York City, the families of students can be overwhelmed by the long list of schools, each of which promises secondary education for students with curriculum ranging from biology to engineering to musical theater. The options seem endless. Using the public high school data sets released by NYC Department of Education, I made this…

Contributed by Xinyuan Wu. 

In the NBA, a top player makes around a thousand shots during the entire regular season. A question worth asking is: What information can we get by looking at these shots? As a basketball fan for more than 10 years, I am particularly interested in discovering facts that can not be directly seen on live TV. When I was surfing on web last week, I found a data set called NBA shot-log from Kaggle. This data summarizes every shot made by each…

Contributed by Regan Yee.

New York City — it's known for its fast walkers, busy people, and of course aggressive drivers. Many people who live here know that it is a nightmare to drive here; there are too many cars, too few parking spots, jaywalkers, cyclists, flashing lights, honking, and the list goes on. It's no wonder that after living here for a majority of my life that traffic conditions in Boston felt very tame in comparison. When I was in Boston for college, the…

Contributed by Oamar Gianan. He enrolled in the NYC Data Science Academy 12-week full time Data Science Bootcamp program taking place between September 23, 2016 and December 23, 2016. The original article can be found here.

Have you been followed on Twitter or Instagram by someone you don't know? I get this a lot. And so to avoid being thought of as rude, I follow back.…

Contributed by Nathan Stevens. He enrolled in the NYC Data Science Academy 12-week full time Data Science Bootcamp program taking place between September 23, 2016 and December 23, 2016. The original article can be found here.

Introduction

There a numerous use cases for having a searchable database of active STEM (Science Technology…

Contributed by Lei Zhang. 

Recently one phone game spread through the whole world, and cause a lot of interesting topic about the technique behind the game. One of the hot topic is: How to predict the pokemon spawning position?  

Here I developed an app to predict the pokemon spawning position and the probability of spawning at that position. This is the exciting news for the fans of the game, who can easily find the possible spawning position…

Contributed by Kawtar B. 

I. Introduction

The famous cartoon series “The Jetsons” predicted 53 years ago how our lives would look like in 2063 when all our “daily devices” such as home appliances or cars would be connected to the internet. In 2016, the Internet of Things (IoT) is still evolving to a convergence of multiple technologies, including wireless communication, real-time analytics, machine learning, commodity sensors, embedded systems,…

Contributed by Joseph van Bemmelen.

There are many newspapers available in the New York City area that cater to different segments of the population. This project focuses on the Wall Street Journal (WSJ), an international newspaper with a high circulation in the New York area. For this project, I scraped details of articles over a three-week period in order to analyze some basic metrics of the newspaper as well as some of the topics that the WSJ focuses…