Really cool idea! I tried a few Spanish ones (I speak Spanish) and unfortunately it was marking things as incorrectly wrong on 2/5 videos I did!
Every video is transcribed to get much better transcripts than the closed captions. I filter on high quality transcripts, and afterwards a LLM selects only plausible segments for the exercises. This seems to work well for quality control and seems to be reliable enough for these short exercises.
Would love your thoughts!
Really cool idea! I tried a few Spanish ones (I speak Spanish) and unfortunately it was marking things as incorrectly wrong on 2/5 videos I did!
That's a bit unfortunate, sorry about that!
I only checked English, French, Dutch and German and assumed that Spanish would be OK. Was this for drag & drop. And do you maybe have the video? Maybe I need to tune the quality threshold specifically for Spanish videos.
I actually did the same video on desktop and the same answers worked fine! Screenshots of it failing in an android webview, but passing on desktop firefox: https://imgur.com/a/vALlFdH.