Most active commenters
  • soulofmischief(3)
  • mumbisChungo(3)
  • regmaticalistic(3)

←back to thread

Tools: Code Is All You Need

(lucumr.pocoo.org)
313 points Bogdanp | 38 comments | | HN request time: 1.918s | source | bottom
Show context
pclowes ◴[] No.44454741[source]
Directionally I think this is right. Most LLM usage at scale tends to be filling the gaps between two hardened interfaces. The reliability comes not from the LLM inference and generation but the interfaces themselves only allowing certain configuration to work with them.

LLM output is often coerced back into something more deterministic such as types, or DB primary keys. The value of the LLM is determined by how well your existing code and tools model the data, logic, and actions of your domain.

In some ways I view LLMs today a bit like 3D printers, both in terms of hype and in terms of utility. They excel at quickly connecting parts similar to rapid prototyping with 3d printing parts. For reliability and scale you want either the LLM or an engineer to replace the printed/inferred connector with something durable and deterministic (metal/code) that is cheap and fast to run at scale.

Additionally, there was a minute during the 3D printer Gardner hype cycle where there were notions that we would all just print substantial amounts of consumer goods when the reality is the high utility use case are much more narrow. There is a corollary here to LLM usage. While LLMs are extremely useful we cannot rely on LLMs to generate or infer our entire operational reality or even engage meaningfully with it without some sort of pre-existing digital modeling as an anchor.

replies(4): >>44455110 #>>44455475 #>>44455505 #>>44456514 #
1. foobarbecue ◴[] No.44455475[source]
Hype cycle for drones and VR was similar -- at the peak, you have people claiming drones will take over package delivery and everyone will spend their day in VR. Reality is that the applicability is more narrow.
replies(6): >>44455895 #>>44456324 #>>44456606 #>>44457214 #>>44458356 #>>44460090 #
2. jangxx ◴[] No.44455895[source]
I mean both of these things are actually happening (drone deliveries and people spending a lot of time in VR), just at a much much smaller scale than it was hyped up to be.
replies(3): >>44456311 #>>44456337 #>>44456408 #
3. giovannibonetti ◴[] No.44456311[source]
Drones and VR require significant upfront hardware investment, which curbs adoption. On the other hand, adopting LLM-as-a-service has none of these costs, so no wonder so many companies are getting involved with it so quickly.
replies(1): >>44456555 #
4. soulofmischief ◴[] No.44456324[source]
That's the claim for AR, not VR, and you're just noticing how research and development cycles play out, you can draw comparisons to literally any technology cycle.
replies(1): >>44458294 #
5. pxc ◴[] No.44456337[source]
A parallel outcome for LLMs sounds realistic to me.
6. deadbabe ◴[] No.44456408[source]
If it’s not happening at the scale it was pitched, then it’s not happening.
replies(2): >>44456491 #>>44456563 #
7. jangxx ◴[] No.44456491{3}[source]
This makes no sense, just because something didn't become as big as the hypemen said it would doesn't make the inventions or users of those inventions disappear.
replies(1): >>44457396 #
8. nativeit ◴[] No.44456555{3}[source]
Right, but abstract costs are still costs to someone, so how far does that go before mass adoption turns into a mass liability for whomever is ultimately on the hook? It seems like there is this extremely risky wager that everyone is playing--that LLM's will find their "killer app" before the real costs of maintaining them becomes too much to bear. I don't think these kinds of bets often pay off. The opposite actually, I think every truly revolutionary technological advance in the contemporary timeframe has arisen out of its very obvious killer app(s), they were in a sense inevitable. Speculative tech--the blockchain being one of the more salient and frequently tapped examples--tends to work in pretty clear bubbles, in my estimation. I've not yet been convinced this one is any different, aside from the absurd scale at which it has been cynically sold as the biggest thing since Gutenberg, but while that makes it somewhat distinct, it's still a rather poor argument against it being a bubble.
9. falcor84 ◴[] No.44456563{3}[source]
Considering what we've been seeing in the Russia-Ukraine and Iran-Israel wars, drones are definitely happening at scale. For better or for worse, I expect worldwide production of drones to greatly expand over the coming years.
10. threatofrain ◴[] No.44456606[source]
Good drones are very Chinese atm, as is casual consumer drone delivery. Americans might be more than a decade away even with concerted bipartisan war-like effort to boost domestic drone competency.

The reality is Chinese.

replies(1): >>44457843 #
11. ivape ◴[] No.44457214[source]
You checked out drone warfare? It’s all the rage in every conflict at the moment. The hype around drones is not fake, and I’d compare it more to autonomous cars because regulation is the only reason you don’t see a million private drones flying around.
replies(2): >>44457523 #>>44465240 #
12. deadbabe ◴[] No.44457396{4}[source]
For something to be considered “happening” you can’t just have a handful of localized examples. It has to be happening at a large noticeable scale that even people unfamiliar with the tech are noticing. Then you can say it’s “happening”. Otherwise, it’s just smaller groups of people doing stuff.
13. dazed_confused ◴[] No.44457523[source]
Yes, to an extent, but I would say that is an extension of artillery and long-range fire capabilities.
replies(1): >>44457772 #
14. jmj ◴[] No.44457772{3}[source]
As is well known, AI is whatever hasn't been done yet.
15. sarchertech ◴[] No.44457843[source]
Aren’t people building DIY drones that are close to and in some cases superior to off the shelf Chinese drones?
replies(1): >>44457909 #
16. threatofrain ◴[] No.44457909{3}[source]
Off the shelf Chinese drones is somewhat vague, we can just say DJI. Their full drone and dock system for the previous generation goes for around $20k. DJI iterates on this space on a yearly cadence and have just come out with the Dock 3.

54 minute flight time (47 min hover) for fully unmanned operations.

If you're talking about fpv racing where tiny drones fly around 140+ mph, then yeah DJI isn't in that space.

replies(1): >>44458312 #
17. 65 ◴[] No.44458294[source]
That is in fact the claim for VR. Remember the Metaverse? Oculus headsets are VR headsets. The Apple Vision Pro is a VR headset.
replies(2): >>44458402 #>>44459713 #
18. sarchertech ◴[] No.44458312{4}[source]
That hardly seems like it would take the US 10 years to replicate on a war footing aside from the price.

I mean if we’re talking dollar to dollar comparison, the US will likely never be able to produce something as cheaply as China (unless China drastically increases their average standard of living).

replies(2): >>44459688 #>>44465013 #
19. golergka ◴[] No.44458356[source]
People claimed that we would spend most of our day on the internet in the mid-90s, and then the dotcom bubble burst. And then people claimed that by 2015 robo-taxis would be around all the major cities of the planet.

You can be right but too early. There was a hype wave for drones and VR (more than one for the latter one), but I wouldn't be so sure that it's peak of their real world usage yet.

replies(2): >>44458918 #>>44459868 #
20. mumbisChungo ◴[] No.44458402{3}[source]
The metaverse is and was a guess at how the children of today might interact as they age into active market participants. Like all these other examples, speculative mania preceded genuine demand and it remains to be seen whether it plays out over the coming 10-15 years.
replies(1): >>44458761 #
21. sizzle ◴[] No.44458761{4}[source]
Ahh yes let’s get the next generation addicted to literal screens strapped to their eyeballs for maximum monetization, humanity be damned. Glad it’s a failing bet. Now sex bots might be onto something…
replies(2): >>44458801 #>>44466746 #
22. mumbisChungo ◴[] No.44458801{5}[source]
It may or may not be a failing bet. Maybe smartphones are the ultimate form of human-data interface and we'll simply never do better.
replies(1): >>44459202 #
23. skeeter2020 ◴[] No.44458918[source]
>> You can be right but too early.

Unless opportunity cost is zero this is a varation on being wrong.

24. jrm4 ◴[] No.44459202{6}[source]
I'll take your argument a bit further. The thing is -- "human-data" interfaces are not particularly important. Human-Human ones are. This is probably why it's going to be difficult, if not impossible, to beat the smartphone; VR or whatever doesn't fundamentally "bring people closer together" in a way the smartphone nearly absolutely did.
replies(1): >>44459232 #
25. mumbisChungo ◴[] No.44459232{7}[source]
VR may not, but social interaction with AR might be more palatable and better UX than social interaction while constantly looking down at at a computer we still call a "phone" for some reason.
26. tonyarkles ◴[] No.44459688{5}[source]
There’s a really weird phenomenon too with drones. I’ve used Chinese (non-drone) software for work a bunch in the past and it’s been almost universally awful. On the drone side, especially DJI, they’ve flipped this script completely. Every non-DJI drone I’ve flown has had miserable UX in comparison to DJI. Mission Planner (open source, as seen in the Ukraine attack videos) is super powerful but also looks like ass and functions similarly. QGC is a bit better, especially the vendor-customized versions (BSD licensed) but the vendors almost always neuter great features that are otherwise available in the open source version and at the same time modify things so that you can’t talk to the aircraft using the OSS version. The commercial offerings I’ve used are no better.

Sure, we need to be working on being able to build the hardware components in North America, and I’ve seen a bunch of people jump on that in the last year. But wow is the software ever bad and I haven’t really seen anyone working to improve that.

27. outworlder ◴[] No.44459713{3}[source]
> The Apple Vision Pro is a VR headset.

For some use cases it is indeed used for VR. But it has AR applications and all the necessary hardware and software.

28. TeMPOraL ◴[] No.44459868[source]
Which is why I think there are two distinct kinds of perspective, and for one of them, AI hype is just about at the right levels - and being too early is not a problem, unless it delays things indefinitely.

I wrote about it recently here: https://news.ycombinator.com/item?id=44208831. Quoting myself (sorry):

> For me, one of the Beneficiaries, the hype seems totally warranted. The capability is there, the possibilities are enormous, pace of advancement is staggering, and achieving them is realistic. If it takes a few years longer than the Investor group thinks - that's fine with us; it's only a problem for them.

replies(1): >>44465255 #
29. freetinker ◴[] No.44460090[source]
Drones are delivering. Ukraine?
replies(1): >>44465247 #
30. ◴[] No.44465013{5}[source]
31. regmaticalistic ◴[] No.44465240[source]
"Drone warfare" isn't really a thing. Drones in the battlefield remain something that:

a) Hegemon uses to avoid needing to deploy boots to the ground

b) Resource strapped combatants use as a supplement of guerrilla tactics

c) Specops have used to great publicity effect in a context of very heavy use of traditional intelligence assets

The narrative that "this changes everything" is very much in line with how we see the story around AI developing as well. Highly publicized demos that hide the enormous efforts in traditional technologies and good old human labor surrounding them.

32. regmaticalistic ◴[] No.44465247[source]
What exactly are they delivering in Ukraine, besides publicity?
replies(1): >>44467555 #
33. regmaticalistic ◴[] No.44465255{3}[source]
You're getting from it the one thing it can deliver. Dazzle and publicity.
replies(1): >>44465337 #
34. TeMPOraL ◴[] No.44465337{4}[source]
Yes. That, and a shit ton of work done - work I wouldn't manage to do, or wouldn't even try, without AI tools.
35. soulofmischief ◴[] No.44466746{5}[source]
That's extremely judgmental of you. There is strong merit in building online, international but close-knit communities. I have met many friends for life through the internet and through my own experience as CTO of a popular metaverse project (that failed because of a hostile takeover and ridiculous pivot to a sex bot startup that spat in the face of our loyal users)

I cared deeply about our users, about connection and technology. I also love being outside and meeting IRL with friends I've met online. I just took a road trip through the West with a friend from Armenia whom I met doing metaverse work and the exchange of culture was exhilarating.

VR isn't even required for the metaverse, which tells me you're criticizing something of which you have an incomplete understanding. The metaverse is about people and deep connections. About building communities. That's nothing to criticize.

replies(1): >>44481568 #
36. pixl97 ◴[] No.44467555{3}[source]
Ammunition? Supplies? Explosives to the enemy?
37. sizzle ◴[] No.44481568{6}[source]
You know you can do all that in meatspace for free right now, as our species has been doing since the dawn of civilization.

I’m not convinced a literal screen strapped to your face can beat your human senses perceiving the world and other human beings in the flesh at a biochemical level.

Not until people are strapped with IV drug releasing devices flooding their brains with happy chemicals to imitate the joy of real life experiences with others. That would be barely scratching the surface of imitating human-human interaction.

replies(1): >>44493989 #
38. soulofmischief ◴[] No.44493989{7}[source]
The cool thing is that I don't need your approval or permission to decide how I want to network with others, or in what ways I decide to integrate technology into my networking.

> I’m not convinced a literal screen strapped to your face can beat your human senses perceiving the world and other human beings in the flesh at a biochemical level.

No shit? I already said VR isn't a core part of the metaverse vision. Zuckerburg didn't invent the concept of the metaverse or its modern incarnation, he co-opted it and even changed his company name in an attempt to make the metaverse synonymous with his company and particular vision. Do everyone a favor and decouple this from your understanding of what the metaverse scene set out to do.

My network stretches across the globe, it's impossible to replicate this without technology. Judge less, seek to understand more.