←back to thread

Apple just released a weirdly interesting coding language model

(9to5mac.com)
164 points ksec | 2 comments | 05 Jul 25 11:44 UTC | HN request time: 0s | source
Show context
vintagedave ◴[08 Jul 25 10:53 UTC] No.44498853[source]▶
Does diffusion allow for 'size editing'? Unsure how to ask this, or if this (most likely) reveals a fundamental misunderstanding of my own, but: for an image, the size is set (say, 256x256.) For text, if each token were a pixel, it's very small. The article image showed text colour-coded by generation order. What if it would need to, say, insert another line for the rest of a comment sentence? How would it even know the size upfront, the way an image size is known?
replies(1): >>44499164 #
1. mjp ◴[08 Jul 25 11:56 UTC] No.44499164[source]▶
Yes, block diffusion for example generates fixed-size blocks of text, but can dynamically change the number of blocks.

The Zed team recently posted a pretty good intro to diffusion models for text: https://www.youtube.com/watch?v=oot4O9wMohw

replies(1): >>44500627 #
2. mdaniel ◴[08 Jul 25 15:00 UTC] No.44500627[source]▶
That was interesting, although it's unclear why there's only one other person in a Zoom. However, it turns out that I was glad to have someone there because they asked the question I had about the interaction between diffusion and prompting <https://www.youtube.com/watch?v=oot4O9wMohw&t=977> which made it click why one would use this diffusion setup for code completion specifically. The "prompt" is the current state of the (file|line) and it then diffuses text into place