Brexit inertia means London’s finance workers face summer slump