"For what have I to do with judging outsiders? Is it not those inside the church whom you are to judge? God judges those outside. 'Purge the evil person from among you.' " (ESV)
Church discipline is a good thing. It shows love for God, for the flock of the church, and even for the offender. Church discipline is almost never easy; but, when done rightly, it always brings good benefits.
God makes a distinction between those inside, and outside, the church, (note also vv. 9-11 of this chapter of 1 Cor. 5). Those "outside," God judges; those "inside," the elders are to judge.
Thank God if He has been kind enough to put you in a faithful local church; and never take your privileges as a member of Christ for granted.
[Puritan quote of the day: "This fear, this grace of fear, this son-like fear of God, flows from the distinguishing love of God toward His elect." --John Bunyan, in, "The Fear of God"]