Remove FD task after connection is created.