Report: Patterson leaving