I'd say this criticism is well-addressed in aider. Steering the LLM via code comments is the first UX I've seen that works.
https://aider.chat/docs/usage/watch.html
How jarring it is & how much it takes you out of your own flow state is very much dependent on the model output quality and latency still, but at times it works rather nicely.