Use correct public key in public key auth as responder.