Its beyond difficult, but there are votes and investigations, and SCOTUS supremes can get involved if its subverting the US constitution.... which it looks likely on Pelosi's part. The normal way, is a vote. A motion to vacate is brought by another member of the House, even a republican, and then the Speaker loses a new election, and a different (dem likely) is selected.