←back to thread

416 points floverfelt | 5 comments | | HN request time: 0.721s | source
Show context
ares623 ◴[] No.45056350[source]
> Other forms of engineering have to take into account the variability of the world.

> Maybe LLMs mark the point where we join our engineering peers in a world on non-determinism.

Those other forms of engineering have no choice due to the nature of what they are engineering.

Software engineers already have a way to introduce determinism into the systems they build! We’re going backwards!

replies(6): >>45056412 #>>45056449 #>>45056511 #>>45056669 #>>45056797 #>>45059375 #
didericis ◴[] No.45056511[source]
Part of what got me into software was this: no matter how complex or impressive the operation, with enough time and determination, you could trace each step and learn how a tap on a joystick lead to the specific pixels on a screen changing.

There’s a beautiful invitation to learn and contribute baked into a world where each command is fully deterministic and spec-ed out.

Yes, there have always been poorly documented black boxes, but I thought the goal was to minimize those.

People don’t understand how much is going to be lost if that goal is abandoned.

replies(3): >>45056889 #>>45057390 #>>45057729 #
1. pton_xd ◴[] No.45056889[source]
Agreed. The beauty of programming is that you're creating a "mathematical artifact." You can always drill down and figure out exactly what is going on and what is going to happen with a given set of inputs. Now with things like concurrency that's not exactly true, but, I think the sentiment still holds.

The more practical question is though, does that matter? Maybe not.

replies(2): >>45057031 #>>45057133 #
2. DSingularity ◴[] No.45057031[source]
In a way this is also a mathematical artifact — after all tokens are selected through beam searching or some random sampling of likely successor tokens.
3. didericis ◴[] No.45057133[source]
> The more practical question is though, does that matter?

I think it matters quite a lot.

Specifically for knowledge preservation and education.

replies(2): >>45057407 #>>45058329 #
4. bathtub365 ◴[] No.45057407[source]
Yep, LLM’s still run on hardware with the same fundamental architecture we’ve had for years, sitting under a standard operating system. The software is written in the same languages we’ve been using for a long time. Unless there’s some seismic shift where all of these layers go away we’ll be maintaining these systems for a while.
5. beefnugs ◴[] No.45058329[source]
Yes, but : not in all cases really. There are plenty of throw away, one off, experimental, trial and error, low stakes, spammy, interactions with dumb-assery, manager replacing instances that are acceptable as being quickly created and forgotten black boxes of temporary barely working trash. (not that people will limit to the proper uses)