The major consequence is unhappiness.
If you don’t make an effort to pursue a passion you’ll likely harbor a lot of resentment.
You will spend a lot of time regretting that piece of your life.
No matter if you give up, go against, or never pursue your passion at all those feelings of emptiness and unhappiness will creep into your everyday life.
If in the bottom of your heart you feel as if you are meant to do something specific with your life and never do that specific thing how could you be happy?
You couldn’t.
No matter the alternatives you create to keep your attention elsewhere, it will always linger.
There will always be a hole where your passion lies.