Just bought an XE and Im scared of people

Very excited about my XE. Its an older model, a 2017 but it is AMAZING. Look feel and speed. Im 33 and have only seen older guys in the Jags but this car is stunning. My biggest concern is dealing with envy, I'm kind of afraid of the looks I'm getting. I have been in a jalopy for two years, I'm talking sun burnt, broken fender and busted! But I saw some of my neighbors faces earlier and it was kind of scary. Has anyone experienced this?