Every video is transcribed to get much better transcripts than the closed captions. I filter on high quality transcripts, and afterwards a LLM selects only plausible segments for the exercises. This seems to work well for quality control and seems to be reliable enough for these short exercises.
Would love your thoughts!
Duolingo is tough because they set the expectation that this should be free, so you're walking into a challenging business.
But I think the concept is fundamentally better to connect language learning to something entertaining and relevant. If you can make that work, you have a heck of an app.
You can do it!
At the end of the day, whether it's effective or not, Duolingo sells the feeling that you are learning a language to people. Winning a competition with Duolingo means doing better at making people feel like they are learning a language -- the strategy to win against Duolingo probably involves watering down the learning even more, to better sell the feeling.
A good way to think about it is look at some organization that wants to be effective at actually teaching its employees a new language, like the state department:
https://www.state.gov/foreign-service-institute/foreign-lang...
20 hours a week of intensive instruction.
Spanish 30 weeks Cantonese 88 weeks Turkish 44 weeks
This is what it actually takes.
Duolingo is for people that will never travel for more than a weekend once every other year, and its fine that its entertaining for them or their last minute crash course to feel less ignorant. Lately I've seen it used by people that want to feel closer to their roots.
But I don't think people actually engaging with other cultures and going abroad to do so are still using this. On the other hand, LLM's are really good at slang and colloquialisms, something neither Duolingo or an in person teacher will reveal to you.
I'm just very unsure whether it's possible to design an effective language learning program that is "engaging" in the way that Duolingo users want it. At the end of the day, you should feel engagement from using the language (and seeing yourself improve) and not from external gimmicks.