Probably too late a reply to help much, but that scenario is deliberately played with reduced warbands, ie not all the heroes are present and at least half the combatants must be henchmen. So simplest solution would be to assume the artifact wielder refuses to give it up so is refused entry and cannot be one of the heroes present for the brawl.