Peter Mandelson has been removed from his post over his close relationship with the late sex offender Jeffrey Epstein.