Anthony Albanese has been urged to step up and take control.