←back to thread

923 points zh2408 | 1 comments | | HN request time: 0s | source
Show context
ryao ◴[] No.43740101[source]
I would find this more interesting if it made tutorials out if the Linux, LLVM, OpenZFS and FreeBSD codebases.
replies(3): >>43740141 #>>43740152 #>>43743972 #
zh2408 ◴[] No.43740152[source]
The Linux repository has ~50M tokens, which goes beyond the 1M token limit for Gemini 2.5 Pro. I think there are two paths forward: (1) decompose the repository into smaller parts (e.g., kernel, shell, file system, etc.), or (2) wait for larger-context models with a 50M+ input limit.
replies(3): >>43740668 #>>43741788 #>>43745188 #
1. rtolsma ◴[] No.43740668[source]
You can use the AST for some languages to identify modular components that are smaller and can fit into the 1M window