I hate it when people say vegans eat weird food. Literally, everything vegans eat, so can meat-eaters. I hear you there!
Has your brother even tried food you make? Maybe that would help him know that it's NOT weird food. My other thought is that maybe he's teasing you as a sort-of way to connect with you? Or is it more mean, rather than a little joking? If it is meanly intended, I hope he will stop ASAP. If it's more well-intentioned, but it hurts your feelings, maybe you could still tell him?