maybe you accidetnly forgot to upp his loyalty?

its happened to me once..(silly me..)