You guys as aways are right.
He fights Jack off, would kill Jack for wanting it, expects Jack to be there.
He hit Jack that last day, for one reason, "You're not in control of me, I am." and when he didn't hear from him for fours year, that punch must have worked.