The field called “machine learning” should really be called “applied statistics”
Babies learn through prediction. If something happens that they do not expect, then they are interested. Mistakes are an opportunity to learn.
Machine learning builds non-parametric model as they assume that the parameter set (or feature set)) is not fixed and can increase, or even decrease if new relevant information is collected.
Machine Learning: The High Interest Credit Card of Technical Debt - tech debt (ie neural net are hard to understand and maintain)