I have troubles riding with no stirrups?

I can canter fine with no stirrups, but my horses transition from canter to trot is a nightmare, I always loose my balance because it trot is so bouncy. How can I work on that?