It's kind of an established thing that you finish the duel at a later date as long as it's not too far into the future. You didn't feel like he wronged you, you just wanted an easy shot at his TC instead of a fair fight.