(metr.org)

688 points dheerajvs | 2 comments | 10 Jul 25 16:29 UTC | HN request time: 0s | source

Show context

narush ◴[10 Jul 25 17:28 UTC] No.44523346[source]▶

Hey HN, study author here. I'm a long-time HN user -- and I'll be in the comments today to answer questions/comments when possible!

If you're short on time, I'd recommend just reading the linked blogpost or the announcement thread here [1], rather than the full paper.

[1] https://x.com/METR_Evals/status/1943360399220388093

replies(7): >>44523757 #>>44523844 #>>44523891 #>>44524187 #>>44524724 #>>44524983 #>>44528188 #

1. causal ◴[10 Jul 25 18:09 UTC] No.44523844[source]▶

>>44523346 #

Hey I just wanted to say this is one of the better studies I've seen - not clickbaity, very forthright about what is being claimed, and presented in such an easy-to-digest format. Thanks so much for doing this.

replies(1): >>44524296 #

2. narush ◴[10 Jul 25 18:57 UTC] No.44524296[source]▶

>>44523844 (TP) #

Thanks for the kind words!

↑

Measuring the impact of AI on experienced open-source developer productivity