Did a similar thing years ago. I used to work with one of the big 5 accountancy firms in London. Great career with fantastic opportunities, experiences and money. However, ultimately I didn't enjoy the work and knew deep down it wasn't for me. I wanted to change but was worried about taking the step of giving it all up.
Then one day I was sat on the tube and saw a man opposite dressed in his suit, must have been very close to retirement and I thought, if he was my future self looking back over at me would he think - I wish if i was his age i had gone and done something different. That was it for me. Not long after i resigned, went back to Uni to study for a completely different career change, stayed at Uni for far too long then started back in IT as a software developer. Been there for 8 years now and still loving it. I do wonder how much money i'd be on if i had stayed but that is all, i have no regrets. I am far happier where i am now, yes i pushed the restart button which does have repurcussions but like you my committments were minimal.
My philosphy is you get one shot to enjoy the life you have, so dont spend it doing things you don't enjoy. Life is too short, enjoy what you do.