←back to thread

Google Titans architecture, helping AI have long-term memory

(research.google)
584 points Alifatisk | 2 comments | 07 Dec 25 12:23 UTC | HN request time: 0.001s | source
Show context
okdood64 ◴[07 Dec 25 14:05 UTC] No.46181759[source]▶
From the blog:

https://arxiv.org/abs/2501.00663

https://arxiv.org/pdf/2504.13173

Is there any other company that's openly publishing their research on AI at this level? Google should get a lot of credit for this.

replies(12): >>46181829 #>>46182057 #>>46182168 #>>46182358 #>>46182633 #>>46183087 #>>46183462 #>>46183546 #>>46183827 #>>46184875 #>>46186114 #>>46189989 #
mapmeld ◴[07 Dec 25 15:02 UTC] No.46182168[source]▶
Well it's cool that they released a paper, but at this point it's been 11 months and you can't download a Titans-architecture model code or weights anywhere. That would put a lot of companies up ahead of them (Meta's Llama, Qwen, DeepSeek). Closest you can get is an unofficial implementation of the paper https://github.com/lucidrains/titans-pytorch
replies(7): >>46182351 #>>46182946 #>>46184154 #>>46185017 #>>46186942 #>>46187280 #>>46188385 #
1. AugSun ◴[08 Dec 25 01:27 UTC] No.46187280[source]▶
Gemini 3 _is_ that architecture.
replies(1): >>46187485 #
2. FpUser ◴[08 Dec 25 02:03 UTC] No.46187485[source]▶
I've read many very positive reviews about Gemini 3. I tried using it including Pro and to me it looks very inferior to ChatGPT. What was very interesting though was when I caught it bullshitting me I called its BS and Gemini expressed very human like behavior. It did try to weasel its way out, degenerated down to "true Scotsman" level but finally admitted that it was full of it. this is kind of impressive / scary.