Depends on how you handle time-jumps and seasons. It would require some buy-in from all players, but you can weave it in.
So for example, if you start in the summer, your Huscarl could be out game 1 because he’s Viking. And show up for the fall in game 2 and stay for winter in game 3. If you create chars together (say online or via email) you can establish the ties, and simply bring a person back.
If you know game 3 will be a wedding, you can arrange for it in 1 and have the Woman show up.
Hope that helps.
(funny story was going to make a post about this…)