←back to thread

OpenAI, Google and Anthropic are struggling to build more advanced AI

(www.bloomberg.com)
625 points lukebennett | 1 comments | 13 Nov 24 13:28 UTC | HN request time: 0s | source
Show context
WorkerBee28474 ◴[14 Nov 24 18:11 UTC] No.42139220[source]▶
> OpenAI's latest model ... failed to meet the company's performance expectations ... particularly in answering coding questions outside its training data.

So the models' accuracies won't grow exponentially, but can still grow linearly with the size of the training data.

Sounds like DataAnnotation will be sending out a lot more LinkedIn messages.

replies(1): >>42139271 #
1. pton_xd ◴[14 Nov 24 18:15 UTC] No.42139271[source]▶
I thought I saw some paper suggesting that accuracy grows linearly with exponential data. If that's the case it's not a mystery why we'd be hitting a training wall. Not sure I got the right takeaway from that study, though.

EDIT: here's the paper https://arxiv.org/abs/2404.04125