Yes, it really is difficult. It's hard enough just doing it based on observable abilities at a given point of time, but it is much more than that. Things like burnout, growth spurts, improvement trajectory, academics, injuries, partying, etc. can all come it to play when looking back at a board years later.