Matt Gaetz, the former Florida representative who this week withdrew from consideration to be US attorney general under Donald Trump, said on Friday he would not seek to return to Congress.

“I’m still going to be in the fight but it’s going to be from a new perch,” Gaetz told the rightwing podcaster and radio host Charlie Kirk. “I do not intend to join the 119th Congress.”

Gaetz is a dedicated far-right controversialist and staunch Trump loyalist who last year played a key role in the removal of Republican Kevin McCarthy as House speaker, the first such move ever orchestrated by a speaker’s own party.

Picked for attorney general during a plane ride with Trump, Gaetz was seen as likely to carry out the president-elect’s agenda of revenge on his political enemies and pardons for allies, including those convicted over the deadly 6 January 2021 attack on the US Capitol by supporters of Trump who sought in vain to overturn his 2020 loss to Joe Biden.

Gaetz swiftly resigned his US House seat, which he had held for nearly three full terms on Capitol Hill.

His resignation pre-empted the release of a House ethics committee report into allegations of misconduct including allegedly paying for sex with a girl under the age of consent.

Ron DeSantis, the Florida governor, issued an executive order on Friday evening, setting a special election to fill the former representative’s seat with a primary election on 28 January and a general election on 1 April.

“At Gov Ron DeSantis’ direction, this special election is being conducted as quickly as statutorily possible,” Cord Byrd, the Florida secretary of state, said in a press release. “We are committed to ensuring this election is held as soon as we are allowed to hold it by state law.”

Amid renewed controversy, Gaetz denied wrongdoing and pointed to a justice department decision to drop an investigation of the matter.

Nonetheless, amid feverish speculation over the report and whether the confirmation would fail, Gaetz announced his withdrawal on Thursday.

Get the most important US headlines and highlights emailed direct to you every morning

after newsletter promotion

Debate followed about whether Gaetz could or would seek to return to the House when the new Congress is sworn in next year.

But on Friday Gaetz told Kirk: “There are a number of fantastic Floridians who’ve stepped up to run for my seat, people who have inspired with their heroism, with their public service. And I’m actually excited to see north-west Florida go to new heights and have great representation.

“I’m 42 now, and I’ve got other goals in life that I’m eager to pursue – my wife and my family – and so I’m going to be fighting for President Trump. I’m going to be doing whatever he asks of me, as I always have. But I think that eight years is probably enough time in the United States Congress.”