The moment he realizes that Flemming hasn't been to the Old City before/has minimal combat ability, he'll insist on bringing someone else along who does. He wants a challenge and a change of pace, not death.

Oh and if Flemming starts doing anything... questionable? Just give Banzu plausible deniability and he'll stay out of the way.