Many will bleat on about how spacers basically turn your car in a 1973 Citroen Diane but personally I think that's a load of old @*!#.
That really doesn't sound right unless you are slatting it around corners or tracking it. I could hardly notice it at all regardless of how I drove (20 ml all round)