Can't stand my friend?

Do him and yourself a favor. Tell him directly that he is irritating to you. It sounds like you were childhood friends and are growing up differently. I am here to tell you that he probably has romantic feelings for you and it seems that you do not especially care for him as a bf. So put it to him straight. You can hurt his feelings in the short term or drag out this long uncomfortable relationship to its ultimate unhappy ending. I've seen this sort of thing before.