(research.google)

584 points Alifatisk | 1 comments | 07 Dec 25 12:23 UTC | HN request time: 0.224s | source

Show context

nubg ◴[07 Dec 25 14:22 UTC] No.46181850[source]▶

Very interesting. Is it correct for me to imagine it as some kind of "LoRA" thats continuously adapted as the model goes through its day?

If so, could there perhaps be a step where the LoRA is merged back into the main model?

That would be like sleeping :-)

1. robrenaud ◴[07 Dec 25 14:34 UTC] No.46181941[source]▶

I don't think that's a great analogy.

LoRAs tend to be adapters bolted onto to systems by people other than the system designers, and they are low rank factorizations.

There is nothing low rank or adapter here.

Google Titans architecture, helping AI have long-term memory