How to order stuff Vanilla NNs with fully connected layers work by each neuron receiving all the outputs of the previous layer (or the inputs in the case of input layers) and then doing calculations over them and the weights and biases of the given neuron. This works well in general, but is especially good when each input value has a specific meaning, e.g. [, , , .