The only sexual deviance in his life that I'm aware of was a wrongful conviction.
Sexual deviance does appear to run in the family.
"The bad blood thickened between Avery and the Manitowoc County Sheriff’s Department in January 1985, when Avery ran a deputy’s wife off the road at gunpoint and tried to force her into his car. The woman, Sandra Morris, was Avery’s cousin and a friend of Manitowoc County Deputy Sheriff Judy Dvorak. Morris had complained to police that Avery had exposed himself in his front yard on several occasions when she drove past his house. Avery let the woman go when she told him her infant daughter was alone in her car."
"All three brothers have been charged with violent crimes. In 1988, Steven’s older brother, Chuck, was charged and later acquitted of second-degree sexual assault. In 1998, a judge found him guilty of disorderly conduct following a family altercation. He got 12 months’ probation. Less than a year later, he was charged with raping and attempting to strangle his wife with a telephone cord. In court, the couple agreed to defer judgment pending further violence by Chuck, and the charge was finally dismissed in 2003. The couple subsequently divorced.
Meanwhile, in 1992, Steve’s younger brother, Earl Avery, was arrested after his wife claimed he beat and choked her during a drunken argument. Earl pleaded no contest to battery and was sentenced to 10 days in jail and 18 months’ probation. Three years later, he was charged with sexual assault of a child. He pleaded no contest to fourth-degree sexual assault and battery and spent 45 days in jail and three years on probation."
"Earl claims his brother, Steven, manipulated him as well. Years ago, when Steven was first sent to prison and Earl was 14 or 15, Steven would call him from his cell block and order Earl to have sex with Steven’s then-wife, Lori."