Ehh, that's pretty vague. How does it work?
>Request demo
Oh. Well how much is it?
>Request pricing
Oh never mind
* A communication protocol, json-rpc esque except it can be done over stdio or via HTTP
* A discovery protocol, like Swagger, to document the "tools" that an endpoint exposes and how it should be used
* A tool calling convention, the specific sequence of tokens the LLM needs to output for something to be recognized as a tool call
* A thin glue layer orchestrating all of the above: injecting the list of available tools into the LLM context, parsing LLM output to detect tool calls and invoke them with appropriate args, and inject results back into LLM context
Outside of a few notable exceptions, the software industry has become such a joke.
Yeah llm rules. You think there must be something more to it. There's not.
All of this is just software engineers grasping to stay relevant