←back to thread

Google Titans architecture, helping AI have long-term memory

(research.google)
584 points Alifatisk | 1 comments | 07 Dec 25 12:23 UTC | HN request time: 0s | source
Show context
okdood64 ◴[07 Dec 25 14:05 UTC] No.46181759[source]▶
From the blog:

https://arxiv.org/abs/2501.00663

https://arxiv.org/pdf/2504.13173

Is there any other company that's openly publishing their research on AI at this level? Google should get a lot of credit for this.

replies(12): >>46181829 #>>46182057 #>>46182168 #>>46182358 #>>46182633 #>>46183087 #>>46183462 #>>46183546 #>>46183827 #>>46184875 #>>46186114 #>>46189989 #
mapmeld ◴[07 Dec 25 15:02 UTC] No.46182168[source]▶
Well it's cool that they released a paper, but at this point it's been 11 months and you can't download a Titans-architecture model code or weights anywhere. That would put a lot of companies up ahead of them (Meta's Llama, Qwen, DeepSeek). Closest you can get is an unofficial implementation of the paper https://github.com/lucidrains/titans-pytorch
replies(7): >>46182351 #>>46182946 #>>46184154 #>>46185017 #>>46186942 #>>46187280 #>>46188385 #
informal007 ◴[07 Dec 25 15:25 UTC] No.46182351[source]▶
I don't think model code is a big deal compared to the idea. If public can recognize the value of idea 11 months ago, they could implement the code quickly because there are so much smart engineers in AI field.
replies(2): >>46182445 #>>46183173 #
1. mapmeld ◴[07 Dec 25 17:06 UTC] No.46183173[source]▶
Well we have the idea and the next best thing to official code, but if this was a big revelation where are all of the Titan models? If this were public, I think we'd have a few attempts at variants (all of the Mamba SSMs, etc.) and get a better sense if this is valuable or not.