←back to thread

396 points doener | 6 comments | | HN request time: 0s | source | bottom
1. thih9 ◴[] No.46176197[source]
As an AI outsider with a recent 24GB macbook, can I follow the quick start[1] steps from the repo and expect decent results? How much time would it take to generate a single medium quality image?

[1]: https://github.com/Tongyi-MAI/Z-Image?tab=readme-ov-file#-qu...

replies(3): >>46176279 #>>46176998 #>>46178238 #
2. altmanaltman ◴[] No.46176279[source]
If you don't know anything about AI in terms of how these models are run, comfyui's macos version is probably the easiset to use. There is already a Z-Image workflow that you can get and comfyui will get all the models you need and get it work together. Can expect decent speed
replies(2): >>46176433 #>>46176539 #
3. thih9 ◴[] No.46176433[source]
I'm fine with the quick start steps and I prefer CLI to GUI anyway. But if I try it and find it too complex, I now know what to try instead - thanks.

I'm still curious whether this would run on a MacBook and how long would it take to generate an image. What machine are you using?

4. egeozcan ◴[] No.46176539[source]
Have a 48GB M4 Pro and every inference step takes like 10 seconds on a 1024x1024 image. so six steps and you need a minute. Not terrible, not great.
5. aleyan ◴[] No.46176998[source]
I have a 24GB M5 macbook pro. In ComfyUI using default z-image workflow, generating a single image just took me 399 seconds, during which the computer froze and my airpods lost audio.

On replicate.com a single image takes 1.5s at a price of 1000 images per $1. Would be interesting to see how quick it is on ComfyUI Cloud.

Overall, running generative models locally on Macs seems very poor time investment.

replies(1): >>46177423 #
6. Eisenstein ◴[] No.46178238[source]
Try koboldcpp with the kcppt config file. The easiest way by far.

Download the release here

* https://github.com/LostRuins/koboldcpp/releases/tag/v1.103

Download the config file here

* https://huggingface.co/koboldcpp/kcppt/resolve/main/z-image-...

Set +x to the koboldcpp executable and launch it, select 'Load config' and point at the config file, then hit 'launch'.

Wait until the model weights are downloaded and launched, then open a browser and go to:

* http://localhost:5001/sdui

EDIT: This will work for Linux, Windows and Mac