One Catholic Church has found that those who left did so because of the sex scandals and its stance against gays

From an NBC affiliate in Philadelphia: 

A Catholic parish in Philadelphia surveyed lapsed Catholics to find out why they left. The results show a dissatisfaction at both the local level and with the Vatican. 

Of the 189 former Catholics who responded to the survey, the highest percentage — 17 percent — said they did so because of the priest abuse scandal. The director of the survey, Charles Zech of Villanova University's Center for the Study of Church Management, said a secondary reason follows close behind. 

"People who are going to leave the church over the scandal and the church's handling of it have already left. So people leaving the church today are leaving for other reasons," said Zech. "A growing reason we found out was the church's attitude toward homosexuals and gay marriage. A lot of younger people object to the church's teaching on that."

I have seen the same thing happen in formerly devoutly Catholic family.  If you make Catholics choose between the welfare of their children and families or protecting the corrupt and bloated Church hierarchy, they will choose love.