On Few-Annotation Learning and Non-Linearity in Deep Neural Networks

Learning something new in real life does not necessarily mean going through a lot of examples in order to capture the essence of it. Humans are able to build upon prior experience and have the ability to adapt, allowing to combine previous observations with only little evidence for fast learning.