Five tribes of machine learning
| Tribe | Origins | Master Algorithm | ||
|---|---|---|---|---|
| Symbolists | Logic, philosophy | Inverse deduction | ||
| Connectionists | Neuroscience | Backpropagation | ||
| Evolutionaries | Evolutionary biology | Genetic programming | ||
| Bayesians | Statistics | Probabilistic inference | ||
| Annalogizers | Psychology | Kernel machines |
How do computers discover new knowledge?
- Fill in graps in existing knowledge
- Emulate the brain
- Simulate evolution
- Systematically reduce uncertainty
- Notice similarities between old and new