I'm strictly speaking never going to think of model distillation as "stealing." It goes against the spirit of scientific research, and besides every tech company has lost my permission to define what I think of as theft forever
replies(3):
Though it's poetic justice that OpenAI is complaining about someone else playing fast and loose with copyright rules.
Even if you give GenAI unlimited time, it will not develop its own writing/drawing/painting style or come up with a novel idea, because strictly by how it works it can only create „new” work by interpolating its dataset
The compatibility of determinism and freedom of will is still controversially debated. There is a good chance that Humans don’t „create“.
> There’s no deliberation behind AI, just statistical probabilities. There’s no new or spontaneous thoughts, at most pseudorandomness introduced by the author of the model interface.
You can say exactly the same about deterministic humans since it is often argued that the randomness of thermodynamic or quantum mechanical processes is irrelevant to the question of whether free will is possible. This is justified by the fact that our concept of freedom means a decision that is self-determined by reasons and not a sequence of events determined by chance.
Determinism and free will are pretty irrelevant here.
Unless P=NP, there's no way for us to distinguish in general between eg pseudo random systems and truly random systems from the outside.
Btw, I don't think determinism in humans/AI has anything to do with deliberation.
The newest AI models are allowed to deliberate. At least by some meanings of the word.
> This is justified by the fact that our concept of freedom means a decision that is self-determined by reasons and not a sequence of events determined by chance.
Well, different people have different definitions here. None of them very satisfying.
No. It’s the other way around. Free will is the basic for „creating something new“.
> Btw, I don't think determinism in humans/AI has anything to do with deliberation.
With determinism there is no deliberation.
As far as we can tell, all the laws of the universe are completely deterministic. (And that includes quantum mechanics.) As far as we can tell, human beings obey the laws of physics.
(To explain: quantum mechanics as a theory is completely deterministic and even linear. Some outdated interpretations of quantum mechanics, like Copenhagen, use randomisation. But interpretations don't make a difference to what the underlying theory actually is. And more widely accepted interpretations like 'Many Worlds' preserve the determinism of the underlying theory.)
Btw, neural nets are typically sampled from, and you can use as good a random number generator (even a physical random number generator) as there is, if you want to. I don't think it'll change what we think neural nets are capable of.