Yeah, "simple" as in we didn't have to make something that can learn general concepts, and then teach it language. It feels like a hack, doesn't it? Like you were working on a problem you thought was NP-hard and then you stumble over a way to do it in O(n^2).
Yeah, I think we get sidetracked by how it “feels” to us when we learn. We forget that is just a convenient story that our mind tells itself. We are incapable or at least severely handicapped when it comes to raw experience and the knowing of it.
Somehow this approach to ML feels kind of natural to me, but it’s hard to articulate why.
