←back to thread

Kimi Linear: An Expressive, Efficient Attention Architecture

(github.com)
210 points blackcat201 | 1 comments | 31 Oct 25 00:07 UTC | HN request time: 0.214s | source
Show context
softwaredoug ◴[31 Oct 25 14:50 UTC] No.45772588[source]▶
Everyone is worried about AI data centers destroying the planet with their extreme energy needs. Though it seems we have a big learning curve still to make AI inference and training more efficient.

How likely are we to NOT see the AI data center apocalypse through better algorithms?

replies(4): >>45772794 #>>45773341 #>>45774160 #>>45774881 #
1. naasking ◴[31 Oct 25 16:57 UTC] No.45774160[source]▶
> How likely are we to NOT see the AI data center apocalypse through better algorithms?

Near certain IMO. Algorithmic improvements have outpaced hardware improvements for decades. We're already seeing the rise of small models and how simple tweaks can make small models very capable problem solvers, better even than state of the art large models. Data center scaling is nearing its peak IMO as we're hitting data limits which cap model size anyway.