←back to thread

2127 points bakugo | 3 comments | | HN request time: 0s | source
Show context
jumploops ◴[] No.43163548[source]
> "[..] in developing our reasoning models, we’ve optimized somewhat less for math and computer science competition problems, and instead shifted focus towards real-world tasks that better reflect how businesses actually use LLMs.”

This is good news. OpenAI seems to be aiming towards "the smartest model," but in practice, LLMs are used primarily as learning aids, data transformers, and code writers.

Balancing "intelligence" with "get shit done" seems to be the sweet spot, and afaict one of the reasons the current crop of developer tools (Cursor, Windsurf, etc.) prefer Claude 3.5 Sonnet over 4o.

replies(4): >>43163694 #>>43164052 #>>43164203 #>>43164889 #
eschluntz ◴[] No.43164203[source]
Thanks! We all dogfood Claude every day to do our own work here, and solving our own pain points is more exciting to us than abstract benchmarks.

Getting things done require a lot of booksmarts, but also a lot of "street smarts" - knowing when to answer quickly, when to double back, etc

replies(2): >>43164322 #>>43164660 #
LouisSayers ◴[] No.43164322[source]
Could you tell us a bit about the coding tools you use and how you go about interacting with Claude?
replies(1): >>43164561 #
catherinewu ◴[] No.43164561[source]
We find that Claude is really good at test driven development, so we often ask Claude to write tests first and then ask Claude to iterate against the tests
replies(1): >>43164780 #
Kerrick ◴[] No.43164780[source]
Write tests (plural) first, as in write more than one failing test before making it pass?
replies(1): >>43167085 #
zarmin ◴[] No.43167085[source]
Time to look up TDD, my friend.
replies(2): >>43173040 #>>43175211 #
1. DrammBA ◴[] No.43173040{3}[source]
One of today's lucky 10,000. His mind is about to expand beyond imagination.
replies(1): >>43180000 #
2. DrammBA ◴[] No.43180000[source]
I wish I could delete my original comment now that I found out that Kerric wasn't a lucky 10,000, he's just an asshole...
replies(1): >>43180953 #
3. zarmin ◴[] No.43180953[source]
Well, you lucky-10,000'd people who didn't know about the 10,000 thing. That's not nothing.