Liberal Supreme Court Justices say that the deported Maryland man must return to the U.S.