What I noticed a few years ago when I decided to bring myself up to date again on machine learning after a ten years break (and what ten years that was for the domain!) I read a ton and watched several online classes.
I realized that the pace was very different from the classes I had been during my student years: classes were boring, so I had time to think about stuff.
The rhythm that I found worked really well for such information-dense subjects was 1:1 breaks. One hour of classes. One hour to think about it (usually I would go for a walk)
Internet taught us to drink from a firehose, but our brain needs some time to process the information. It can't accumulate information and digest it at the same time.
You just learned about drop-out layers or the drawbacks of softmax? Don't feel bad about switching off the computer and think about it. No one is judging that you are "doing nothing".
I remember that on my last corporate job, I used to go for a break/walk when stuck on a nasty bug and would often come back with the solution. My colleagues frowned a bit upon that but luckily my boss, a former researcher, totally approved of the method.
I assume he means that going for a walk provides alternating periods of unconscious processing and deliberate thinking in a similar cadence to that described in the study. I'm not always actively practicing when I'm out walking, there are times wh... Ooh, a squirrel!
My assumption is that there is a difference between actively pushing yourself to think about it by adding new stuff to your brain as opposed to simply digesting the already added.
I read somewhere that you are not thinking consciously about the problem, but the unconscious is. I do it quite a but, walk away, get lunch and come back and viola! you have the solution!
I realized that the pace was very different from the classes I had been during my student years: classes were boring, so I had time to think about stuff.
The rhythm that I found worked really well for such information-dense subjects was 1:1 breaks. One hour of classes. One hour to think about it (usually I would go for a walk)
Internet taught us to drink from a firehose, but our brain needs some time to process the information. It can't accumulate information and digest it at the same time.
You just learned about drop-out layers or the drawbacks of softmax? Don't feel bad about switching off the computer and think about it. No one is judging that you are "doing nothing".
I remember that on my last corporate job, I used to go for a break/walk when stuck on a nasty bug and would often come back with the solution. My colleagues frowned a bit upon that but luckily my boss, a former researcher, totally approved of the method.