El Problemo. As Guillaume Berger warned me of here, it turns out that when you ask Keras to do PReLUs, it allocates one learnable “alpha” parameter per neuron! Consequence: I went from …| Olexa Bilaniuk's IFT6266H16 Course Blog