You generally have to watch from the start to understand. I watched Haruhi Season Two before one, which really confused me. You'd be able to later grasp it, but you'd still never fully understand.