←back to thread

Google Titans architecture, helping AI have long-term memory

(research.google)
584 points Alifatisk | 1 comments | 07 Dec 25 12:23 UTC | HN request time: 0.294s | source
Show context
okdood64 ◴[07 Dec 25 14:05 UTC] No.46181759[source]▶
From the blog:

https://arxiv.org/abs/2501.00663

https://arxiv.org/pdf/2504.13173

Is there any other company that's openly publishing their research on AI at this level? Google should get a lot of credit for this.

replies(12): >>46181829 #>>46182057 #>>46182168 #>>46182358 #>>46182633 #>>46183087 #>>46183462 #>>46183546 #>>46183827 #>>46184875 #>>46186114 #>>46189989 #
mapmeld ◴[07 Dec 25 15:02 UTC] No.46182168[source]▶
Well it's cool that they released a paper, but at this point it's been 11 months and you can't download a Titans-architecture model code or weights anywhere. That would put a lot of companies up ahead of them (Meta's Llama, Qwen, DeepSeek). Closest you can get is an unofficial implementation of the paper https://github.com/lucidrains/titans-pytorch
replies(7): >>46182351 #>>46182946 #>>46184154 #>>46185017 #>>46186942 #>>46187280 #>>46188385 #
informal007 ◴[07 Dec 25 15:25 UTC] No.46182351[source]▶
I don't think model code is a big deal compared to the idea. If public can recognize the value of idea 11 months ago, they could implement the code quickly because there are so much smart engineers in AI field.
replies(2): >>46182445 #>>46183173 #
jstummbillig ◴[07 Dec 25 15:37 UTC] No.46182445[source]▶
If that is true, does it follow this idea does not actually have a lot of value?
replies(2): >>46182827 #>>46183206 #
fancy_pantser ◴[07 Dec 25 17:09 UTC] No.46183206[source]▶
Student: Look, there’s hundred dollar bill on the ground! Economist: No there isn’t. If there were, someone would have picked it up already.

To wit, it's dangerous to assume the value of this idea based on the lack of public implementations.

replies(3): >>46183726 #>>46185648 #>>46190464 #
1. lukas099 ◴[07 Dec 25 18:15 UTC] No.46183726[source]▶
If the hundred dollar bill was in an accessible place and the fact of its existence had been transmitted to interested parties worldwide, then yeah, the economist would probably be right.