So does apple, coconut, cracker, gin, barbarian, brownie, skinny, spade, spook, teabag and a whole host of different words.
It should never be about the word itself, but how it’s being used. Someone being called a genius doesn’t usually mean they are being applauded for their intellect either, for example.