(CNN) — Malcolm-Jamal Warner, who played son Theo Huxtable on “The Cosby Show,” says the sitcom’s legacy has been “tarnished” by the torrent of sexual allegations against its star, Bill Cosby.

“My biggest concern is when it comes to images of people of color on television and film, no matter what … negative stereotypes of people of color, we’ve always had ‘The Cosby Show’ to hold up against that,” Warner told The Associated Press in an interview this week.

“And the fact that we no longer have that, that’s the thing that saddens me the most because in a few generations the Huxtables will have been just a fairy tale.”

Warner became the latest cast member of the long-running hit show — praised by many for its depiction of a wholesome, successful African-American family — to weigh in on the mushrooming scandal that has dogged Cosby over the past year and forced fans to reconsider his image as an avuncular father figure.

The veteran comedian and actor has been accused of sexual misconduct spanning decades by more than 40 women. In a court deposition 10 years ago, Cosby said he had sexual relationships with at least five women outside his marriage and gave prescription sedatives to women with whom he wanted to have sex.

Cosby, 78, has never been criminally charged and has vehemently denied wrongdoing. He was tentatively scheduled to give a sworn deposition Friday in a civil suit alleging he sexually assaulted a 15-year-old girl at the Playboy Mansion in 1974.

NBC’s “Dateline” was scheduled to air a joint interview Friday with 27 of Cosby’s accusers. And just last week three more women came forward to accuse Cosby of sexually inappropriate behavior, including sexual assault, dating back to the 1970s.

As fellow entertainers have increasingly denounced Cosby, his “Cosby Show” co-stars have expressed a range of more muted responses.

Phylicia Rashad, Cosby’s TV wife, expressed support for him in January, saying the allegations were “orchestrated” as part of an effort to keep him off television. Since then she has said little about the scandal.

Keshia Knight Pulliam, who played the youngest Huxtable daughter, defended the show’s legacy in an interview published this week.

“You can’t take back the impact that it’s had on generations of kids, and it’s continuing to have such a positive impact on them,” the actress told the Grio. As for the accusations against Cosby, Pulliam said, “That’s just not the man I know.”

Cosby’s other TV daughters, actresses Sabrina Le Beauf, Lisa Bonet and Tempestt Bledsoe, have not commented publicly on the allegations.

But actor Joseph C. Phillips, who played Cosby’s son-in-law for three seasons on the show, posted an online essay in July headlined, “Of course Bill Cosby is guilty!”

“As the accusations began to increase, I became increasingly disturbed,” he wrote. “I was fairly certain that some of the women were lying through their teeth, but certainly not all of them.”

In comments in January about the Cosby accusations, Warner expressed cautious support for his former TV dad.

“I can’t really speak on any of the allegations because obviously, I was not there. The Bill Cosby I know has been great to me and great for a lot of people. What he’s done for comedy and television has been legendary and history-making. What he’s done for the black community and education has been invaluable. That’s the Bill Cosby I know. I can’t speak on the other stuff,” Warner told Billboard.

After “The Cosby Show” ended in 1992, Warner has had a successful second career as a director and Grammy-winning musician.

He told the AP this week that he has been in touch with Cosby, but he declined to comment on their conversations.

“I think the things that we discussed really have to stay private between us,” said Warner, 45. “But it’s just a bad situation all around — for him, for his family, the women, their families, the legacy of the show.”