gonna get worse mate, sorry
mine was an occasional thing, and after a few months I ended up crunching every single time I was changing gear... new gearbox under warranty. Dealer even admitted Nissan had new synchros in it...
I always do 4th to 6th as redlining in 4th leaves you already at a very high speed...