←back to thread

2127 points bakugo | 1 comments | | HN request time: 0.209s | source
Show context
lysace ◴[] No.43163135[source]
It's fascinating how close these companies are to each other. Some company comes up with something clever/ground-breaking and everyone else has implemented it a few weeks later.

Hard not to think of Kurzweil's Law of Accelerating Returns.

replies(4): >>43163205 #>>43163347 #>>43163364 #>>43163723 #
1. luma ◴[] No.43163723[source]
Where RL can play into post training there's something of an anti-moat. Maybe a "tow rope"?

Let's say OAI releases some great new model. The moment it becomes available via API, everyone else can make use of that model to create high-quality RL training data, which can then be used to make their models perform better.

The very act of making an AI model commercially available is the same act which allows your competitors to pull themselves closer to you.