←back to thread

663 points domenicd | 1 comments | | HN request time: 0s | source
Show context
JackDanMeier ◴[] No.44021401[source]
I was working on a product which has FSRS implemented, and is heavily inspired by anki. The change we made was that rather than rate yourself, you have to type your answer and its graded by an LLM. It also has a button to explain the concept to you as if you are 5 (eli5) and you get feedback on your answer. You can also create the flashcards by uploading a pdf and then generate them from it.

I've stopped working on it and am now building something highly similar aimed towards high school students, but any feedback is welcome. This version was built for uni students

mimair.com - I never got around to adding any payment option so its completely free

replies(3): >>44021461 #>>44021551 #>>44021809 #
TheDong ◴[] No.44021461[source]
> graded by an LLM

This seems impossible to me. In anki, there's "hard", "good", and "easy" which are all for "I got this right".

For my usage, "hard" is "I got it right, but I was only like 60% sure", "good" is "I had to actively think", and "easy" is "effortlessly correct, no real thought required".

There's no way for an AI to tell if my identical input is the result of a 50/50 guess, or a little thought, or effortless recall. "delay to answer" also isn't a good approximation, I have a habit of alt-tabbing and chatting with a friend on random cards of any difficulty.

I find distinguishing those levels of easy for totally identical answers ends up making SRS more effective, and AI just can't know my inner thoughts. Maybe once we have brain implants.

replies(2): >>44021508 #>>44021596 #
ix101 ◴[] No.44021596[source]
One way it could grade you automatically is by the speed of flipping the card (or entering the correct answer). If it took less than a second to confirm then evidently it was easy.
replies(3): >>44021635 #>>44021662 #>>44021707 #
1. TheDong ◴[] No.44021635{3}[source]
But conversely, if I alt-tabbed to chat with a friend, or paused studying because the person sitting next to me asked a question, or I took a sip from my coffee mug, that doesn't mean it's hard necessarily. Even though all of those take at least as much time as answering a hard card un-interrupted would.

The AI cannot read my mind, there is no approximation that will work reasonably accurately here for "how confident was I in my answer", unless I input that myself.