Wilders loses more and more party frontman