Over the past few months, we've been covering OpenAI applications like MuseNet and Jukebox. These are some of the most cutting edge AI music applications to date. But OpenAI wasn't the first company to venture into this space. Google started publishing generative music applications a few years earlier, under the name Magenta. The Magenta Team first presented the machine learning model at a Moogfest workshop in 2016. A year later, Google Brain researcher Douglas Eck gave the following talk on Ten| AudioCipher
Discussions: Hacker News (64 points, 3 comments), Reddit r/MachineLearning (219 points, 18 comments) Translations: Simplified Chinese, French, Korean, Russian, Turkish This year, we saw a dazzling application of machine learning. The OpenAI GPT-2 exhibited impressive ability of writing coherent and passionate essays that exceed what we anticipated current language models are able to produce. The GPT-2 wasn’t a particularly novel architecture – it’s architecture is very similar to the de...| jalammar.github.io
A quick intro to Transformers, a new neural network transforming SOTA in machine learning.| daleonai.com