The leader skill can never be lost by a warband elader, as that one is automatically gained for any leaders. Also, I'd say the spell can be lost as well, as it is granted on skill rolls. However, one could also argue that since a spell technically isnt a skill (the spells are not on the skill lists) tehy cannot be lost.