Do you think that I can start over at a different church?

Yes I think you should leave this church. When you say church presume you mean a Christian church rite? The behavior of the church members doesn't sound at all Christian and they are not following the example set by Jesus who would of accepted and forgiven you no matter what you had done.