Ex-PM: Give up on trying to unify Jerusalem