←back to thread

Zamba2-7B

(www.zyphra.com)
282 points dataminer | 1 comments | 14 Oct 24 22:45 UTC | HN request time: 0.204s | source
Show context
whoistraitor ◴[15 Oct 24 00:23 UTC] No.41843682[source]▶
Cool! Seems we’re moving closer and closer to realizing the Lottery Ticket Hypothesis https://arxiv.org/abs/1803.03635
replies(1): >>41843688 #
ipunchghosts ◴[15 Oct 24 00:24 UTC] No.41843688[source]▶
How is this related?
replies(1): >>41843739 #
1. whoistraitor ◴[15 Oct 24 00:35 UTC] No.41843739[source]▶
Ah apologies I misread the architecture. But it does fit the spirit of finding disproportionately higher performance in smaller networks. Still promises of finding smaller sub networks. Running on mediocre mobile devices doesn’t seem a dream when stuff like this is released. Exciting!