←back to thread

237 points sandslash | 1 comments | | HN request time: 0.235s | source
Show context
w10-1 ◴[] No.44535288[source]
Not sure why this has drawn silence and attacks - whence the animus to Ng? His high-level assessments seem accurate, he's a reasonable champion of AI, and he speaks credibly based on advising many companies. What am I missing? (He does fall on the side of open models (as input factors): is that the threat?)

He argues that landscape is changing (at least quarterly), and that services are (best) replaceable (often week-to-week) because models change, but that orchestration is harder to replace, and that there are relatively few orchestration platforms.

So: what platforms are available? Are there other HN posts that assess the current state of AI orchestration?

(What's the AI-orchestration acronym? not PAAS but AIOPAAS? AOP? (since aspect-oriented programming is history))

replies(8): >>44535527 #>>44535549 #>>44535569 #>>44535659 #>>44536132 #>>44537996 #>>44539312 #>>44539997 #
handfuloflight ◴[] No.44535549[source]
We've defined agents. Let's now define orchestration.
replies(1): >>44535955 #
ramraj07 ◴[] No.44535955[source]
Bold claim. I am not convinced anyone's done a good job defining agents and if they did 99% of the population has a different interpretation.
replies(1): >>44535984 #
handfuloflight ◴[] No.44535984[source]
Okay. We've tried to define agents. Now let's try to define orchestration.
replies(1): >>44536597 #
lhuser123 ◴[] No.44536597[source]
And make it more complicated than K8s
replies(1): >>44537927 #
jliptzin ◴[] No.44537927[source]
Not possible
replies(1): >>44538110 #
1. vajrabum ◴[] No.44538110[source]
The platforms I've seen live on top of kubernetes so I'm afraid it is possible. nvidia-docker, all the cuda libraries and drivers, nccl, vllm,... Large scale distributed training and inference are complicated beasties and the orchestration for them is too.