that's not a very innovative idea or even better UX.
I think that the future wil have to do with voice commands and mcps will be the backend, exposing capabilities.
replies(2):
When you want to order a pizza, you won't have to click. Just browse and ask the AI assistant to place an order as you would in a restaurant. Better UX.
Isn't on demand what chat llms already do nowadays btw?
point being that generating visual UI components is easy. chatgpt does it. server driven UI does it.
But multimodal interaction is something else that goes further.
You might say naming the color is enough, but in reality, a color picker is the more natural way to interact.
As humans, we don’t communicate only through words. Other forms of interaction matter too.
It will probably have access to a list of components with their specifications, especially the type of data that the components allow to mutably (or not) represent.
Or respond to a query from a database by presenting a graph automatically.
But the hard part is to turn natural language into a sql query in my opinion. It's not really the choice of data representation which is heavily informed by the data itself (type and value) and doesn't require much inference.