If you can't simply be yourself around him, warts and all, that's a red flag. I understand his frustration a little; my boyfriend is zoo, but more zoo exclusive than I am, and now for the most part we've put a hold on sex until we can find a furry friend to join in.
That being said, though, I still tell him everything, and try to get him to tell me things. We make each other laugh, I comfort him through anxiety and tears (I rarely get that way, but he's there just in case). He tolerates my random pedantic tangents and I tolerate his dark sense of humor. We talk things out and try to make it work. It's not perfect now, but it gets better all the time, and it's a constant effort for me to factor him in, make sure his needs are met too.
My point is, you don't have to be the same as your partner, and you really shouldn't be, since they can balance out some of your flaws. But you should be your most authentic self with your partner. That doesn't mean being selfish and doing only what you like; it means being completely honest with each other, with the hope that you each can be better off as individuals by being together as a couple.