Geraldo Rivera.Photo:Jared Siskin/Patrick McMullan via Getty Images

Geraldo Rivera attends Sean Hannity & Friends celebrate the publication of “The Geraldo Show: A Memoir”

Jared Siskin/Patrick McMullan via Getty Images

Geraldo Riverasaid that a “toxic relationship” with a co-host of the Fox News programThe Fiveplayed a role inhis departure from the news networkafter 23 years last month.

At the time of his Fox News exit, the veteran journalist initially suggested that he leftThe Fiveat his own will, but has now said that he was “fired” fromThe Fiveand decided to quit the network altogether.

“I had a very toxic relationship with another of the cast members,” Rivera, 80, said during an appearance on ABC’sThe ViewThursday.

Geraldo Rivera with Joy Behar on ‘The View.'.ABC

Joy Behar and Geraldo Rivera on ‘The View’.

ABC

The Fiveis a five-person panel talk show. Four of the voices are conservative, while the fifth is liberal. Rivera appeared on the show as a rotating liberal personality — along with Jessica Tarlov and Harold Ford Jr. — and hosted with regular conservative voicesJesse Watters,Dana Perino,Jeanine PirroandGreg Gutfeld.

Rivera notably had a number of on-air clashes with Gutfeld. In April, Rivera told Gutfeld to “stop pointing at me” when they argued over electric vehicles, per AP. Meanwhile, last year Rivera called Gutfeld “an arrogant punk” during a discussion about abortion.

Last month in anAssociated Pressinterview, Rivera cited “growing tension” atThe Fiveas a reason for vacating his co-host seat. “It has been a rocky ride but it has also been an exhilarating adventure that spanned quite a few years,” he told the outlet. “I hope it’s not my last adventure.”

‘The Five’ with then-member Geraldo Rivera.Fox News

The Five

Fox News

He continued: “So I got a call from two of the female executives and they said, ‘You’re offThe Five, but there are plenty of other things you could do.’ I had a year and a half left on my contract and I said, ‘Well, stop it. If you fired me from the No.1 show, then I’m going to quit.’ And that’s basically what happened.

“But in the interim, as in the days that led up to my last day of work, they were so kind to me. They really were so nice, remembering all the things we did together over the 20-odd years. Remember I went there to be a war correspondent after the 9/11 attacks.”

Rivera later said: “I thought that it was very unfair that I was not judged objectively in our disputes, but rather he was always favored…I was suspended, you know, three times my appearances, I had two to three appearances scheduled weekly, then bi-weekly, then monthly, then they kind of disappeared. They were canceled in the last day, right before I was supposed to go on. So I was a really ticked-off guy.”

Behar noted that since Rivera used male pronouns to describe the unnamed person, he can’t be referencing his former Fox News colleague Pirro.

Geraldo Rivera.Roy Rochlin/Getty

Geraldo Rivera

Sunny Hostin, Behar’s colleague onThe View, earlier asked Rivera why the news channel couldn’t create a new show for him.

“They could have, I guess. My ideology does not fit Fox. They always kind of squeezed me in. I came as a war correspondent. I did 11 assignments in Iraq, 11 assignments in Afghanistan in the Mideast, Somalia, you know, every hot spot on the globe…the reason I went to Fox was gone. I shouldn’t have left Fox then in 2011. But I didn’t.”

Never miss a story — sign up forPEOPLE’s free daily newsletterto stay up-to-date on the best of what PEOPLE has to offer.

On June 30,Rivera made an appearance onFox and Friendsand said he was celebrating his 80th birthday on the Fourth of July. In his final segment on the network, Rivera said at the time that he had “such affection for the people in this building.”

“I really, I feel very emotional and deeply moved,” he added, after a montage of his work on Fox was shown to audiences. “I will always remember this morning. It is something that I didn’t expect, this celebration is beyond the beyond.”

PEOPLE reached out to Fox News for comment.

source: people.com