The use of Docker in conjunction with AWS can be highly effective when it comes to building a data pipeline.
Let me ask you if you have ever had this situation before. You are building a model in Python which you need to send over to a third-party, e.g. a client, colleague, etc. However, the person on the other end cannot run the code! Maybe they don't have the right libraries installed, or their system is not configured correctly.
Whatever the reason, Docker alleviates this…Continue
Added by Michael Grogan on July 5, 2019 at 8:30am — No Comments
It's been few months since I started using docker containers for my data science experiments. Docker Containers are becoming very popular these days for reproducible experiments.
I bought a new laptop during Thanksgiving shopping. It was a good deal for a Windows laptop ( Windows 10 Pro). I started trying to setup Docker in Windows and soon realized that it will be a long learning curve. Fortunately for me, my old laptop was still in good…Continue
Added by Renjith Madhavan on January 22, 2017 at 5:00pm — No Comments
The idea of "big data" could conjure up Turing-like images of massive cloud storage centers humming away in a dessert. It's true that up to this point, computing power has been a barrier to analytics, research, and the exploitation of big data. It takes a lot of computing power to process increasingly complicated and elaborate data sets. Companies, therefore, must…Continue
Added by Yuanjen Chen on July 17, 2015 at 11:30am — No Comments