Sharing some of the latest research, announcements, and resources on deep learning. By Isaac Madan Continuing our series of deep learning updates, we pulled together some of the awesome resources that have emerged since our last post. In case you missed it, here are our past updates: , , , , , , , , and the of 20+ resources we outlined in April. As always, this list is not comprehensive, so if there’s something we should add, or if you’re interested in discussing this area further. March part 1 November September part 2 & October part 1 September part 1 August part 2 , August part 1 July part 2 July part 1 June original set let us know Research & Announcements by Google Brain. Google demonstrates a CNN deep learning architecture for identifying tumors in pathology images, at a level better than a human doctor. Detecting Cancer Metastases on Gigapixel Pathology Images by Francois Chollet. The author of Keras announces its rapid ascension from one to over 100K users in two years, as well as their official 2.0 release with a new API and tighter TensorFlow integration. Introducing Keras 2 by Google Research. Useful for audio event detection applications. AudioSet A large-scale dataset of manually annotated audio events: 632 audio event classes and a collection of 2,084,320 human-labeled 10-second sound clips drawn from YouTube videos. by Baidu Research. Baidu also launches SwiftScribe for automated audio transcription . Deep Voice: Real-Time Neural Text-to-Speech for Production A production-quality text-to-speech system constructed entirely from deep neural networks. Deep Voice lays the groundwork for truly end-to-end neural speech synthesis. here by DeepMind. Researchers enable networks to learn tasks in a sequential fashion, as a human would, rather than forgetting prior tasks. Traditionally, neural networks are not capable of this — they experience “catastrophic forgetting.” Overcoming catastrophic forgetting in neural networks Resources at Stanford. Full day workshop on Friday March 31st, 2017 from 9:00am to 4:45pm on the basics behind modern machine learning algorithms, spanning supervised learning, unsupervised learning, ensemble methods, deep learning, and more. The workshop is open to the public. Fundamentals of Machine Learning Workshop Excellent videos from this workshop at NIPS in December, spanning an overview of Bayesian Neural Network history, applications, open research questions, and much more. Bayesian Deep Learning Workshop NIPS 2016 . by Matthew Rubashkin. Part 4 of broader series started in September 2016, — a walkthrough by Silicon Valley Data Science on using deep learning to build a train detector. This post demonstrates using TensorFlow on a Raspberry Pi to do image recognition. TensorFlow Image Recognition on a Raspberry Pi Introduction to Trainspotting by Bob Kot. A cheatsheet that describes basic info on deep learning frameworks like TensorFlow and Theano. Deep Learning Resources Matrix course at Oxford. Advanced course on natural language processing, focusing on recent advances in analyzing and generating speech and text using recurrent neural networks. Many lecturers from DeepMind. Course materials are available on GitHub . Deep Learning for Natural Language Processing here by Nikolas Markou. A helpful cheatsheet on valuable experiential advice & insights gleaned from working with DNNs in practice. Great things to consider as you leverage deep learning. The Black Magic of Deep Learning — Tips and Tricks for the practitioner by Adit Deshpande. Interesting and timely post on using machine learning to predict game outcomes for the upcoming NCAA tournament. Applying Machine Learning To March Madness by YerevaNN. A well-organized and well-designed guide to deep learning, outlining and ranking important resources and papers to learn the subject effectively. A Guide to Deep Learning By . Isaac is an investor at Venrock ( ). If you’re interested in deep learning, we’d love to . Isaac Madan email hear from you is a newsletter of entrepreneurial ideas & perspectives by investors, operators, and influencers. Requests for Startups ** **❤” Please tap or click “︎ to help to promote this piece to others.
