Cars are very subjective things. There is no such thing as the right or wrong answer. Sometimes you just don't get on with something, however much you "ought" to or however much other people like it. It's hard to persuade yourself it's ok if that happens (RXS) - you are probably better to cut your losses and move on to something you love. Having said that, the Z does take a little time to adapt to and appreciate.
As it happens, I just loved the Z from the first time I drove one and mine is pretty much standard (cloth seats and all!)
It helps if you appreciate what it is and what it isn't. I chose it because I had done the more extreme stuff with the Caterhams etc so moving to the Z was a conscious choice which I have not regretted.