All Videos Tagged Spark” (Data Science Central) - Data Science Central 2019-08-25T03:41:57Z https://www.datasciencecentral.com/video/video/listTagged?tag=Spark%E2%80%9D&rss=yes&xn_auth=no DSC Webinar Series: From Pandas to Apache Spark™ tag:www.datasciencecentral.com,2019-07-03:6448529:Video:851584 2019-07-03T19:18:10.864Z Tim Matteson https://www.datasciencecentral.com/profile/2edcolrgc4o4b <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-from-pandas-to-apache-spark"><br /> <img alt="Thumbnail" height="135" src="https://storage.ning.com/topology/rest/1.0/file/get/3189210470?profile=original&amp;width=240&amp;height=135" width="240"></img><br /> </a> <br></br>***Please be aware there is a slight audio issue from approximately 10:45-13:00 in the recording***<br></br> <br></br> Presenting Koalas, a new open source project unveiled by Databricks, that brings the simplicity of pandas to the scalability powers of Apache Spark™.<br></br> <br></br> Data science with Python has exploded in popularity over the past few years and… <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-from-pandas-to-apache-spark"><br /> <img src="https://storage.ning.com/topology/rest/1.0/file/get/3189210470?profile=original&amp;width=240&amp;height=135" width="240" height="135" alt="Thumbnail" /><br /> </a><br />***Please be aware there is a slight audio issue from approximately 10:45-13:00 in the recording***<br /> <br /> Presenting Koalas, a new open source project unveiled by Databricks, that brings the simplicity of pandas to the scalability powers of Apache Spark™.<br /> <br /> Data science with Python has exploded in popularity over the past few years and pandas has emerged as the lynchpin of the ecosystem. When data scientists get their hands on a data set, pandas is often the most common exploration tool. It is the ultimate tool for data wrangling and analysis. In fact, pandas’ read_csv is often the very first command students run in their data science journey.<br /> <br /> The problem? pandas does not scale well to big data. It was designed for small data sets that a single machine could handle. On the other hand, Apache Spark has emerged as the de facto standard for big data workloads. Today many data scientists use pandas for coursework, and small data tasks. When they work with very large data sets, they either have to migrate their code to PySpark's close but distinct API or downsample their data so that it fits for pandas.<br /> <br /> Now with Koalas, data scientists get the best of both worlds and can make the transition from a single machine to a distributed environment without needing to learn a new framework.<br /> <br /> In this latest Data Science Central webinar, the developers of Koalas will show you how:<br /> <br /> Koalas removes the need to decide whether to use pandas or PySpark for a given data set<br /> For work that was initially written in pandas for a single machine, Koalas allows data scientists to scale up their code on Spark by simply switching out pandas for Koalas<br /> Koalas unlocks big data for more data scientists in an organization since they no longer need to learn PySpark to leverage Spark<br /> <br /> Speakers:<br /> Tony Liu, Product Manager, Machine Learning - Databricks<br /> Tim Hunter, Sr. Software Engineer and Technical Lead, Co-Creator of Koalas - Databricks<br /> <br /> Hosted by:<br /> Stephanie Glen, Editorial Director - Data Science Central DSC Webinar Series: Deep Learning - Training your Neural Network tag:www.datasciencecentral.com,2018-10-09:6448529:Video:766746 2018-10-09T22:17:36.773Z Tim Matteson https://www.datasciencecentral.com/profile/2edcolrgc4o4b <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-deep-learning-training-your-neural-network"><br /> <img alt="Thumbnail" height="135" src="https://storage.ning.com/topology/rest/1.0/file/get/2781532418?profile=original&amp;width=240&amp;height=135" width="240"></img><br /> </a> <br></br>In this latest Data Science Central webinar, we will cover the principles for training your neural network including activation and loss functions, batch sizes, data normalization, and validation datasets.<br></br> <br></br> All these concepts will be brought to life by demonstrating how Databricks simplifies deep learning - letting you quickly… <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-deep-learning-training-your-neural-network"><br /> <img src="https://storage.ning.com/topology/rest/1.0/file/get/2781532418?profile=original&amp;width=240&amp;height=135" width="240" height="135" alt="Thumbnail" /><br /> </a><br />In this latest Data Science Central webinar, we will cover the principles for training your neural network including activation and loss functions, batch sizes, data normalization, and validation datasets.<br /> <br /> All these concepts will be brought to life by demonstrating how Databricks simplifies deep learning - letting you quickly access ready-to-use ML environments, as well as prepare data, and train models faster. After this session, if requested, you will receive the presentation and associated notebooks so you can run the samples yourself.<br /> <br /> Speaker:<br /> Denny Lee, Technical Product Manager - Databricks<br /> <br /> Hosted by:<br /> Bill Vorhies, Editorial Director - Data Science Central DSC Webinar Series: An Expert’s Guide to Apache Spark™ tag:www.datasciencecentral.com,2018-05-23:6448529:Video:723863 2018-05-23T22:52:20.713Z Tim Matteson https://www.datasciencecentral.com/profile/2edcolrgc4o4b <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-an-expert-s-guide-to-apache-spark"><br /> <img alt="Thumbnail" height="135" src="https://storage.ning.com/topology/rest/1.0/file/get/2781548053?profile=original&amp;width=240&amp;height=135" width="240"></img><br /> </a> <br></br>Apache Spark™ has become the de-facto data processing and AI engine in enterprises today due to its speed, ease of use, and sophisticated analytics. As the first Unified Analytics engine to unify data with AI, Spark allows data engineering and data science teams to simplify data preparation and model training — enabling innovative AI use cases that… <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-an-expert-s-guide-to-apache-spark"><br /> <img src="https://storage.ning.com/topology/rest/1.0/file/get/2781548053?profile=original&amp;width=240&amp;height=135" width="240" height="135" alt="Thumbnail" /><br /> </a><br />Apache Spark™ has become the de-facto data processing and AI engine in enterprises today due to its speed, ease of use, and sophisticated analytics. As the first Unified Analytics engine to unify data with AI, Spark allows data engineering and data science teams to simplify data preparation and model training — enabling innovative AI use cases that leverage advanced analytics like machine learning, graph analytics, and deep learning.<br /> <br /> Join Bill Chambers, author of the book “Spark: The Definitive Guide,” and Matei Zaharia, Chief Technologist and Co-founder of Databricks and the orginal creator of Apache Spark™, in this Data Science Central webinar as they break down the basic operations and common functions of Spark and walk through sample use cases where Spark has helped accelerate AI innovation.<br /> <br /> In this webinar, we will cover:<br /> <br /> A gentle overview of big data and Spark<br /> Expert guidance on how to use, deploy and maintain Spark <br /> The fundamentals of monitoring, tuning, and debugging Spark<br /> An exploration into machine learning techniques and scenarios for employing MLlib, Spark’s scalable machine-learning library<br /> <br /> Speakers:<br /> Bill Chambers, Product Manager -- Databricks<br /> Matei Zaharia, Co-founder and Chief Technologist -- Databricks<br /> <br /> Hosted by:<br /> Bill Vorhies, Editorial Director -- Data Science Central