All Videos Tagged Data Science Central”, Databricks, (Data Science Central) - Data Science Central 2019-08-17T14:47:54Z https://www.datasciencecentral.com/video/video/listTagged?tag=Data+Science+Central%E2%80%9D%2C+Databricks%2C&rss=yes&xn_auth=no DSC Webinar Series: From Pandas to Apache Spark™ tag:www.datasciencecentral.com,2019-07-03:6448529:Video:851584 2019-07-03T19:18:10.864Z Tim Matteson https://www.datasciencecentral.com/profile/2edcolrgc4o4b <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-from-pandas-to-apache-spark"><br /> <img alt="Thumbnail" height="135" src="https://storage.ning.com/topology/rest/1.0/file/get/3189210470?profile=original&amp;width=240&amp;height=135" width="240"></img><br /> </a> <br></br>***Please be aware there is a slight audio issue from approximately 10:45-13:00 in the recording***<br></br> <br></br> Presenting Koalas, a new open source project unveiled by Databricks, that brings the simplicity of pandas to the scalability powers of Apache Spark™.<br></br> <br></br> Data science with Python has exploded in popularity over the past few years and… <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-from-pandas-to-apache-spark"><br /> <img src="https://storage.ning.com/topology/rest/1.0/file/get/3189210470?profile=original&amp;width=240&amp;height=135" width="240" height="135" alt="Thumbnail" /><br /> </a><br />***Please be aware there is a slight audio issue from approximately 10:45-13:00 in the recording***<br /> <br /> Presenting Koalas, a new open source project unveiled by Databricks, that brings the simplicity of pandas to the scalability powers of Apache Spark™.<br /> <br /> Data science with Python has exploded in popularity over the past few years and pandas has emerged as the lynchpin of the ecosystem. When data scientists get their hands on a data set, pandas is often the most common exploration tool. It is the ultimate tool for data wrangling and analysis. In fact, pandas’ read_csv is often the very first command students run in their data science journey.<br /> <br /> The problem? pandas does not scale well to big data. It was designed for small data sets that a single machine could handle. On the other hand, Apache Spark has emerged as the de facto standard for big data workloads. Today many data scientists use pandas for coursework, and small data tasks. When they work with very large data sets, they either have to migrate their code to PySpark's close but distinct API or downsample their data so that it fits for pandas.<br /> <br /> Now with Koalas, data scientists get the best of both worlds and can make the transition from a single machine to a distributed environment without needing to learn a new framework.<br /> <br /> In this latest Data Science Central webinar, the developers of Koalas will show you how:<br /> <br /> Koalas removes the need to decide whether to use pandas or PySpark for a given data set<br /> For work that was initially written in pandas for a single machine, Koalas allows data scientists to scale up their code on Spark by simply switching out pandas for Koalas<br /> Koalas unlocks big data for more data scientists in an organization since they no longer need to learn PySpark to leverage Spark<br /> <br /> Speakers:<br /> Tony Liu, Product Manager, Machine Learning - Databricks<br /> Tim Hunter, Sr. Software Engineer and Technical Lead, Co-Creator of Koalas - Databricks<br /> <br /> Hosted by:<br /> Stephanie Glen, Editorial Director - Data Science Central DSC Webinar Series: Applying Convolutional Neural Networks with TensorFlow tag:www.datasciencecentral.com,2019-02-18:6448529:Video:803388 2019-02-18T22:57:13.644Z Tim Matteson https://www.datasciencecentral.com/profile/2edcolrgc4o4b <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-applying-convolutional-neural-networks-with"><br /> <img alt="Thumbnail" height="0" src="https://storage.ning.com/topology/rest/1.0/file/get/1136854572?profile=original&amp;width=0&amp;height=0" width="0"></img><br /> </a> <br></br>In this latest Data Science Central Deep Learning Fundamentals Series webinar, we will cover the fundamentals behind TensorFlow and how to apply them within a convolutional neural network (CNN) example. The principles we will cover include CNN concepts and their impact to the accuracy and loss of your network.<br></br> <br></br> All these concepts… <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-applying-convolutional-neural-networks-with"><br /> <img src="https://storage.ning.com/topology/rest/1.0/file/get/1136854572?profile=original&amp;width=0&amp;height=0" width="0" height="0" alt="Thumbnail" /><br /> </a><br />In this latest Data Science Central Deep Learning Fundamentals Series webinar, we will cover the fundamentals behind TensorFlow and how to apply them within a convolutional neural network (CNN) example. The principles we will cover include CNN concepts and their impact to the accuracy and loss of your network.<br /> <br /> All these concepts will be brought to life by demonstrating how Databricks simplifies deep learning - letting you quickly access ready-to-use ML environments, as well as prepare data, and train models faster. After this session, if requested, you will receive the presentation and associated notebooks so you can run the samples yourself.<br /> <br /> Speaker:<br /> Denny Lee, Technical Product Manager - Databricks<br /> <br /> Hosted by:<br /> Bill Vorhies, Editorial Director - Data Science Central DSC Webinar Series: Deep Learning - Introduction to Neural Networks tag:www.datasciencecentral.com,2018-11-13:6448529:Video:777728 2018-11-13T22:51:46.197Z Tim Matteson https://www.datasciencecentral.com/profile/2edcolrgc4o4b <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-deep-learning-introduction-to-neural-networks"><br /> <img alt="Thumbnail" height="135" src="https://storage.ning.com/topology/rest/1.0/file/get/2781532553?profile=original&amp;width=240&amp;height=135" width="240"></img><br /> </a> <br></br>Deep Learning has shown tremendous success, but what makes it so special? What are neural networks, and how do they work? What are the differences between popular Deep Learning frameworks like Keras or TensorFlow, and where should you start?<br></br> <br></br> In this latest Data Science Central webinar, we will show the relationship between… <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-deep-learning-introduction-to-neural-networks"><br /> <img src="https://storage.ning.com/topology/rest/1.0/file/get/2781532553?profile=original&amp;width=240&amp;height=135" width="240" height="135" alt="Thumbnail" /><br /> </a><br />Deep Learning has shown tremendous success, but what makes it so special? What are neural networks, and how do they work? What are the differences between popular Deep Learning frameworks like Keras or TensorFlow, and where should you start?<br /> <br /> In this latest Data Science Central webinar, we will show the relationship between neural networks and simpler ML models, and provide an understanding of what gives neural networks their expressive power.<br /> <br /> We will bring these concepts to life and demonstrate how Databricks simplifies deep learning by letting you quickly access ready to use ML environments as well as prepare data, and train models faster.<br /> <br /> After this session, we’ll arm you with the tools you need to run the samples yourself. Attendees will have access to presentations and associated Databricks notebooks.<br /> <br /> Speaker:<br /> Denny Lee, Technical Product Manager - Databricks<br /> <br /> Hosted by:<br /> Bill Vorhies, Editorial Director - Data Science Central DSC Webinar Series: State of the Art Deep Learning on Apache Spark™ tag:www.datasciencecentral.com,2018-10-31:6448529:Video:773134 2018-10-31T19:21:53.776Z Tim Matteson https://www.datasciencecentral.com/profile/2edcolrgc4o4b <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-state-of-the-art-deep-learning-on-apache-spark"><br /> <img alt="Thumbnail" height="135" src="https://storage.ning.com/topology/rest/1.0/file/get/2781532536?profile=original&amp;width=240&amp;height=135" width="240"></img><br /> </a> <br></br>Big data and AI are joined at the hip: the best AI applications require massive amounts of constantly updated training data to build state-of-the-art models. Increasingly more Spark users want to integrate Spark with distributed machine learning frameworks built for state-of-the-art training.<br></br> <br></br> Here's the problem: big data… <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-state-of-the-art-deep-learning-on-apache-spark"><br /> <img src="https://storage.ning.com/topology/rest/1.0/file/get/2781532536?profile=original&amp;width=240&amp;height=135" width="240" height="135" alt="Thumbnail" /><br /> </a><br />Big data and AI are joined at the hip: the best AI applications require massive amounts of constantly updated training data to build state-of-the-art models. Increasingly more Spark users want to integrate Spark with distributed machine learning frameworks built for state-of-the-art training.<br /> <br /> Here's the problem: big data frameworks like Spark and distributed deep learning frameworks don’t play well together due to the disparity between how big data jobs are executed and how deep learning jobs are executed.<br /> <br /> In this latest Data Science Central webinar, we'll share how Project Hydrogen, a Spark Project Improvement Proposal led by Databricks, is positioned as a potential solution to this dilemma.<br /> <br /> We will cover:<br /> <br /> Barrier execution mode for distributed DL training<br /> Fast data exchange between Spark and DL frameworks, and<br /> Accelerator-awareness scheduling<br /> Speaker:<br /> Xiangrui Meng, Software Engineer - Databricks<br /> <br /> Hosted by:<br /> Bill Vorhies, Editorial Director - Data Science Central DSC Webinar Series: Deep Learning - Training your Neural Network tag:www.datasciencecentral.com,2018-10-09:6448529:Video:766746 2018-10-09T22:17:36.773Z Tim Matteson https://www.datasciencecentral.com/profile/2edcolrgc4o4b <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-deep-learning-training-your-neural-network"><br /> <img alt="Thumbnail" height="135" src="https://storage.ning.com/topology/rest/1.0/file/get/2781532418?profile=original&amp;width=240&amp;height=135" width="240"></img><br /> </a> <br></br>In this latest Data Science Central webinar, we will cover the principles for training your neural network including activation and loss functions, batch sizes, data normalization, and validation datasets.<br></br> <br></br> All these concepts will be brought to life by demonstrating how Databricks simplifies deep learning - letting you quickly… <a href="https://www.datasciencecentral.com/video/dsc-webinar-series-deep-learning-training-your-neural-network"><br /> <img src="https://storage.ning.com/topology/rest/1.0/file/get/2781532418?profile=original&amp;width=240&amp;height=135" width="240" height="135" alt="Thumbnail" /><br /> </a><br />In this latest Data Science Central webinar, we will cover the principles for training your neural network including activation and loss functions, batch sizes, data normalization, and validation datasets.<br /> <br /> All these concepts will be brought to life by demonstrating how Databricks simplifies deep learning - letting you quickly access ready-to-use ML environments, as well as prepare data, and train models faster. After this session, if requested, you will receive the presentation and associated notebooks so you can run the samples yourself.<br /> <br /> Speaker:<br /> Denny Lee, Technical Product Manager - Databricks<br /> <br /> Hosted by:<br /> Bill Vorhies, Editorial Director - Data Science Central