←back to thread

LLM that can call multiple tool APIs with one request

(cohere.com)
129 points ericciarla | 1 comments | 17 Jun 24 21:47 UTC | HN request time: 0s | source
Show context
TZubiri ◴[18 Jun 24 03:10 UTC] No.40713726[source]▶
I do this for a living, Ask Me Anything.

Before they were called tools they were called function calls in ChatGpt.

Before that we had response_format = "json_object"

And even before that we were prompting with function signatures and asking it to output parameters.

replies(3): >>40715632 #>>40722512 #>>40723032 #
1. bhl ◴[18 Jun 24 23:06 UTC] No.40723032[source]▶
What’s the difference between tool calling and “agents”?

How would you handle map-reduce type of tool calls where you have a lot of parallel tools that you want to merge later on? What’s a good way to scale that without running into API limits?