Subscribe to DSC Newsletter

Steve miller's Blog (23)

Mixing & Matching in R for Data Science

I've spent time over the last few months attempting to enhance my skills in the statistical sub-field of causal inference.

Overly simplified, causal inference comprises a series of methodologies and techniques to assist analysts in making the jump from association or correlation to cause and effect.…

Continue

Added by steve miller on October 10, 2018 at 10:00am — 5 Comments

R, Python, Julia -- and Polyglot

A poll released recently showed Python increasing its lead over R as the language of choice for analytics professionals. Setting aside questions of…

Continue

Added by steve miller on September 24, 2018 at 10:55am — No Comments

A Little College Sports Analysis, Part III.

This is the third and (I promise) last of the series "A Little College Sports Analysis", wherein I attempt to use data from the Learfield Directors' Cup to evaluate the prowess…

Continue

Added by steve miller on September 10, 2018 at 11:21am — No Comments

A Little College Sports Analysis II -- 2017-2018 Directors' Cup Conference Rankings

Last time, I wrote on wrangling data from a pdf file to assemble a data set of D1 college athletic performance in the Learfield Directors' Cup competition. In this blog, I…

Continue

Added by steve miller on August 27, 2018 at 10:53am — No Comments

A Little College Sports Analysis, but First a Little Data Wrangling

I'm a big college sports fan, especially active in debates about which D1 conference is best. Five years ago, I came across the Learfield Directors' Cup, an annual evaluation/ranking program of college sports…

Continue

Added by steve miller on August 14, 2018 at 12:35pm — No Comments

a Little SQL with a Little R

My nephew's a very impressive young man. Five years ago, he received a PhD in Biochemistry/Molecular Biology from a prestigious university, earning numerous…

Continue

Added by steve miller on July 16, 2018 at 12:02pm — 5 Comments

ff and Too-Big-for-Memory Data in R -- Part III

After my last blog on the use of relational databases PostgreSQL and MonetDB to help compensate for R's RAM limitations, I received an email from a reader who…

Continue

Added by steve miller on July 2, 2018 at 11:30am — No Comments

PostgreSQL, MonetDB, and Too-Big-for-Memory Data in R -- Part II

In PostgreSQL, MonetDB, and Too-Big-for-Memory Data in R -- Part I, I began to discuss how data that was too big for RAM is handled in R, a memory-constrained statistical…

Continue

Added by steve miller on June 13, 2018 at 10:00am — No Comments

PostgreSQL, MonetDB, and Too-Big-for-Memory Data in R -- Part I

In a blog from three months ago, I wrote on "kind of" big data in R. The "kind of" was meant as a caveat that data size in R is limited by RAM. I also mentioned the potential of working with relational data stores for…

Continue

Added by steve miller on June 4, 2018 at 11:00am — 2 Comments

Poker, Probability, Monte Carlo, and R

My daughter just started a business analytics Master's program. For the probability sequence of the core statistics course, one of her assignments is to calculate the probability of single …

Continue

Added by steve miller on May 23, 2018 at 11:30am — 2 Comments

Frequencies in Pandas -- and a Little R Magic for Python

I've got a big digital mouth. Last time, I wrote on frequencies using R, noting cavalierly that I'd done similar development in…

Continue

Added by steve miller on May 16, 2018 at 12:30pm — No Comments

My Favorite Statistical Procedure? Frequencies!

At a conference I attended a few years ago, a data scientist on a round table discussion replied to a question of what she considered the most important mathematical function in her work with: "the division operator". That clever response provided grist for my later answer to a similar question on…

Continue

Added by steve miller on May 1, 2018 at 8:00am — 1 Comment

Reticulating Python and R -- the American Community Survey Data Dictionary to Meta Data III.

Data Dictionary to Meta Data III is the third and final blog devoted to demonstrating the automation of meta data creation for the American Community Survey 2012-2016 household data set, using a published data dictionary. DDMDI was a teaser to show how Python could be used to generate R statements that…

Continue

Added by steve miller on April 25, 2018 at 9:00am — No Comments

From Data Dictionary to Meta Data with Simple Text Wrangling in Python

My last DSC blog left me a bit disappointed. While the loads of the beefy household and population files for the American…

Continue

Added by steve miller on April 11, 2018 at 12:00pm — No Comments

American Community Survey data in R

I met up with an old grad school friend a few weeks back. He's an accomplished professor of demography, basically the statistical study of populations, particularly surrounding births, deaths, and…

Continue

Added by steve miller on April 4, 2018 at 7:30am — 4 Comments

The R Medicare Factor

Several years ago, I came across a report that led me to a new …

Continue

Added by steve miller on March 22, 2018 at 11:00am — No Comments

College Hoops Conference Rankings

It's that time of the year again -- the start of March Madness, 2018. Last Sunday, the selection show announced the 68 teams, and the preliminary round games start tonight. Of the 68 schools, 32 were automatically selected as conference champions, while the remaining 36 received at large…

Continue

Added by steve miller on March 13, 2018 at 8:30am — No Comments

Tutorial Day at Strata Data San Jose, 2018

Tuesday of Strata Data Conference is my favorite of the four days. The calm before the storm of the keynotes and short presentations of Wednesday-Thursday, Tuesday revolves on half day training sessions that afford reasonably deep dives into technical data science topics. This year my choices were…

Continue

Added by steve miller on March 6, 2018 at 3:00pm — No Comments

"Kindof" Big Data in R

Ask for feedback from just about any critic of the R statistical package and you'll hear two consistent responses: 1) R is a difficult language to learn, and 2) R's data size limitation to physical RAM consigns it to toy academic applications. Having worked with R for over 15 years, I probably shared those views to some extent early on, but no longer.

Yes, R's a language where array-oriented processing and functional…

Continue

Added by steve miller on March 1, 2018 at 9:00am — No Comments

Videos

  • Add Videos
  • View All

Follow Us

© 2018   Data Science Central ®   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service