I know what you mean... it can be frustrating for me when i cant get over 30mph on my way to work in the mornings due to traffic, despite driving down some very nice A-roads. Im usually wound up by the time i get to work, and nail it down the 200m driveway to the office to vent my frustration!
The answer to your problems is to get involved in trackdays, sprinting or drifting as you say. You will quickly appreciate that there's no point in driving fast on the road as its not as much fun as doing it on track.
I went over to the 'ring last summer and loved it, so you're doing the right thing.
As for drifting, if you can find an organised day offering tuition etc then go for it - it's a great sport and very technical (its more difficult than driving fast round a track ). Checkout the driftworks forum and get booked onto an event.