←back to thread

396 points doener | 4 comments | | HN request time: 0.001s | source
1. xfalcox ◴[] No.46175375[source]
We have vLLM for running text LLMs in production. What is the equivalent for this model?
replies(1): >>46176039 #
2. mh- ◴[] No.46176039[source]
I would say there's isn't an equivalent. Some people will probably tell you ComfyUI - you can expose workflows via API endpoints and parameterize them. This is how e.g. Krita AI Diffusion uses a ComfyUI backend.

For various reasons, I doubt there are any large scale SaaS-style providers operating this in production today.

replies(1): >>46180995 #
3. salty_frog ◴[] No.46180995[source]
I'm intrigued by the various reasons why you think there are not any large scale SAAS operating this in production?
replies(1): >>46184121 #
4. threeebo ◴[] No.46184121{3}[source]
i dont believe there is a viable use case for large scale AI-generated images as there is for text... except for porn, but many orgs with SAAS capabilities wouldn't touch that