There is you often be misunderstanding when you start to study improvisation.
Stock, practice and memorize Tonic and Two-five phrases preferentially as the key it often comes!
Writing practice diary considerably increases efficiency also when you practice improvisation.
When you are listening to recordings in your live performances, do you have an experience like you were like being "Uh-oh!"
"Maybe I can't improvise if I don't know what notes of scale are used for the phrases?" That question will often hear.