Today is January 28, 2019, Layue 23, the Year of Earth and Dog, and the Preliminary Eve.| Shen Zhuoran
TL;DR: Learn some very basic linear algebra, learn Python, learn deep learning basics, learn a framework (PyTorch recommended), and start making stuff. Two full-time weeks are more than enough. Fast learner might make it in one week or less.| Shen Zhuoran
TL;DR: Deep Learning SotA is a new, actively maintained, neatly formatted project tracking the states-of-the-art for various tasks of deep learning. Star it if you like it.| Shen Zhuoran
TL;DR: Link to the article: Demystifying the American Graduate Admissions Process.| Shen Zhuoran
Personal site for Shen Zhuoran, an AI researcher and a software engieer for self-driving.| Shen Zhuoran
Efficient Attention: attention with Linear Complexities is a work by myself and colleagues at SenseTime. We proposed a simple but effective method to decrease the computational and memory complexities of the attention mechanism from quadratic to linear, without loss of accuracy. This blog post will introduce the method and major results of the paper.| Shen Zhuoran