I have always said that this little 4 sounds a lot like a low displacement diesel. I am also pretty sure I know the growl you are talking about, and I’m certain it is normal. What is appealing to me is annoying you kind of thing.
To be completely honest, I think there isn’t going to be a solution that eradicates it for you. I would suggest maybe taking a look at the various sound deadening threads in the forum, especially this one by
@eurocarfanatic :
j250-wind-noise-upgrading-to-the-gx-550s-acoustic-front-door-glass-yes-you-can. It isn’t going to completely remove sounds transmitted by something physically attached to your vehicle, but I bet it helps. This little putter of a motor sure has some quirks, and tons of character that many get used to, some absolutely can’t get over, and probably even fewer (like myself) endear. Good luck!