Why does it need to cost a lot of tokens, and why can't it incrementally update?
How do the VS code integrated AI helpers do it?
I’m trying to decide if I should make it into a full-fledged service and completely automate the process of generating the distilled documentation.
Problem is that it would cost a lot in API tokens and wouldn’t generate any revenue (plus it would have to be updated as documentation changes significantly). Maybe Anthropic wants to fund it as a public good? Let me know!
How do the VS code integrated AI helpers do it?