_accelerating-tensorflow-with-apache-arrow-on-spark-bonus-making-it-available-in-scalaholden-karau-google.jpg "Accelerating Tensorflow with Apache Arrow on Spark + bonus making it available* in ScalaHolden Karau (Google) from pandas talk Video Screenshot Preview"){kind=icon}
GalleryPlay Video:
(Note: The default playback of the video is HD VERSION. If your browser is buffering the video slowly, please play the REGULAR MP4 VERSION or Open The Video below for better experience. Thank you!)
⏲ Duration: 17 min 13 sec
✓ Published: 12-Jun-2018
✓ Published: 12-Jun-2018
Description:
Apache Arrow is new in Spark 2.3, and offers faster interchange between Spark and Python. Apache Arrow also has connections to Tensorflow (and even without those can be fed from Pandas). This talk will look at how to use Arrow to accelerate data copy from Spark to Tensorflow, and how to expose basic functionality in Scala for working with Tensorflow. From there we will dive in to how to construct new Deep Learning ML pipeline stages in Python and make them available to be used by our friends in
Apache Arrow is new in Spark 2.3, and offers faster interchange between Spark and Python. Apache Arrow also has connections to Tensorflow (and even without those can be fed from Pandas). This talk will look at how to use Arrow to accelerate data copy from Spark to Tensorflow, and how to expose basic functionality in Scala for working with Tensorflow. From there we will dive in to how to construct new Deep Learning ML pipeline stages in Python and make them available to be used by our friends in
Share with your friends:
Whatsapp | Viber | Telegram | Line | SMS
Email | Twitter | Reddit | Tumblr | Pinterest
Related Videos
_toto39s-train-tunnel-124-let39s-get-measuring-124-kids-learning-cartoon-124-dr-panda-tototime-season-4.webp "Dr. Panda TotoTime – Official Channel")
⏲ 4 minutes 8 seconds 👁 8.1M
_wes-mckinney-pandas-design-and-development.webp "Wes McKinney gives a talk on the development of the python pandas library for data analysis to the New York Python Meetup Group, January 10, 2012.")
_new-immunotherapy-amp-seeing-improvements.webp "Dr. Dan Says")
_world39s-cutest-animals-the-red-panda-124-facts.webp "WorldBeAmazed")
_panda-cubs-and-nanny-meis-war.webp "pandapia HD")
_top-10-cutest-baby-panda-videos.webp "TubeSpaghetti")
_vectorized-udf-scalable-analysis-with-python-and-pyspark-li-jin-two-sigma.webp "Over the past few years, Python has become the default language for data scientists. Packages such as pandas, numpy, statsmodel, and scikit-learn have gained great adoption and become the mainstream toolkits. At the same time, Apache Spark has become the de facto standard in processing big data. Spark ships with a Python interface, aka PySpark, however, because Spark’s runtime is implemented on top of JVM, using PySpark with native Python library sometimes results in poor performance and usabi")
⏲ 17 min 50 sec ✓ 11-Jun-2018
_im-so-jealous-of-panda-nannies-124-ipanda.webp "iPanda")
_toto39s-train-tunnel-124-let39s-get-measuring-124-kids-learning-cartoon-124-dr-panda-tototime-season-4.jpg)
_wes-mckinney-pandas-design-and-development.jpg)
_new-immunotherapy-amp-seeing-improvements.jpg)
_world39s-cutest-animals-the-red-panda-124-facts.jpg)
_panda-cubs-and-nanny-meis-war.jpg)
_top-10-cutest-baby-panda-videos.jpg)
_vectorized-udf-scalable-analysis-with-python-and-pyspark-li-jin-two-sigma.jpg)
_im-so-jealous-of-panda-nannies-124-ipanda.jpg)
![[+]](/images/menu.gif){kind=small}