Yes, simply speak with your employer as Moonworkers allows them to amend your situation.
Here are the different options that you have:
If you are assessed as an eligible jobholder
Opt-out
Contribute more
Re-join
If you are assessed as a non-eligible jobholder
Opt-in
Contribute more
Opt-out
Re-join
If you are assessed as an entitled worker
Voluntary join
Cease membership