2nd Circ. Says Man Can't Challenge Removal Over Atty Failure