←back to thread

Google Titans architecture, helping AI have long-term memory

(research.google)
584 points Alifatisk | 1 comments | 07 Dec 25 12:23 UTC | HN request time: 0s | source
Show context
okdood64 ◴[07 Dec 25 14:05 UTC] No.46181759[source]▶
From the blog:

https://arxiv.org/abs/2501.00663

https://arxiv.org/pdf/2504.13173

Is there any other company that's openly publishing their research on AI at this level? Google should get a lot of credit for this.

replies(12): >>46181829 #>>46182057 #>>46182168 #>>46182358 #>>46182633 #>>46183087 #>>46183462 #>>46183546 #>>46183827 #>>46184875 #>>46186114 #>>46189989 #
Hendrikto ◴[07 Dec 25 14:17 UTC] No.46181829[source]▶
Meta is also being pretty open with their stuff. And recently most of the Chinese competition.
replies(1): >>46181899 #
okdood64 ◴[07 Dec 25 14:28 UTC] No.46181899[source]▶
Oh yes, I believe that's right. What's some frontier research Meta has shared in the last couple years?
replies(5): >>46181949 #>>46181998 #>>46182007 #>>46182046 #>>46183248 #
tonyhart7 ◴[07 Dec 25 14:44 UTC] No.46182007[source]▶
"What's some frontier research Meta has shared in the last couple years?"

the current Meta outlook is embarassing tbh, the fact they have largest data of social media in planet and they cant even produce a decent model is quiet "scary" position

replies(5): >>46182442 #>>46182548 #>>46182589 #>>46182768 #>>46189377 #
1. mirekrusin ◴[07 Dec 25 15:37 UTC] No.46182442[source]▶
Just because they are not leading current sprint of maximizing transformers doesn't mean they're not doing anything.

It's not impossible that they asses it as local maximum / dead end and are evaluating/training something completely different - and if it'll work, it'll work big time.