Manziel's dad thinks it could get "real bad" for JFF