←back to thread

2127 points bakugo | 1 comments | | HN request time: 0.327s | source
Show context
lysace ◴[] No.43163135[source]
It's fascinating how close these companies are to each other. Some company comes up with something clever/ground-breaking and everyone else has implemented it a few weeks later.

Hard not to think of Kurzweil's Law of Accelerating Returns.

replies(4): >>43163205 #>>43163347 #>>43163364 #>>43163723 #
azinman2 ◴[] No.43163347[source]
It’s extremely unlikely that everyone is copying in a few weeks for models that themselves take many weeks if not longer to train. Great minds think alike, and everyone is influencing everyone. The history of innovation is filled with examples of similar discoveries around the same time but totally disconnected in the world. Now with the rate of publishing and the openness of the internet, you’re only bound to get even more of that.
replies(4): >>43163393 #>>43163423 #>>43165162 #>>43173752 #
1. Der_Einzige ◴[] No.43173752[source]
There's never been a scientific field in history with the same radical openness norms that AI/Computational Linguistics folks have (all papers are free/open access and models/datasets are usually released openly and often forced to be MIT or similar licensed)

We have whoever runs NeurIPS/ICLR/ICML and the ACL to thank for this situation. Imagine if fucking Elsevier had strangleholded our industry too!

https://en.wikipedia.org/wiki/Association_for_Computational_...