Years of public insults and backstage stories fueled rumors of bad blood, but one former cast member says the reality was very different