←back to thread

313 points mariano54 | 2 comments | | HN request time: 0.438s | source

Hey HN, we're Mariano and Anton from ISSEN (https://issen.com), a foreign language voice tutor app that adapts to your interests, goals, and needs.

Demo: https://www.loom.com/share/a78e713d46934857a2dc88aed1bb100d?...

We started this company after struggling to find great tools to practice speaking Japanese and French. Having a tutor can be awesome, but there are downsides: they can be expensive (since you pay by the hour), difficult to schedule, and have a high upfront cost (finding a tutor you like often forces you to cycle through a few that you don’t).

We wanted something that would talk with us — realistically, in full conversations — and actually help us improve. So we built it ourselves. The app relies on a custom voice AI pipeline combining STT (speech-to-text), TTS (text-to-speech), LLMs, long term memory, interruptions, turn-taking, etc. Getting speech-to-text to work well for learners was one of the hardest parts — especially with accents, multi-lingual sentences, and noisy environments. We now combine Gemini Flash, Whisper, Scribe, and GPT-4o-transcribe to minimize errors and keep the conversation flowing.

We didn’t want to focus too much on gamification. In our experience, that leads to users performing well in the app, achieving long streaks and so on, without actually getting fluent in the language you're wanting to learn.

With ISSEN you instantly speak and immerse yourself in the language, which, while not easy, is a much more efficient way to learn.

We combine this with a word bank and SRS flashcards for new words learned in the AI voice chats, which allows very rapid improvement in both vocabulary and speaking skills. We also create custom curriculums for each student based on goals, interests, and preferences, and fully customizable settings like speed, turn taking, formality, etc.

App: https://issen.com (works on web, iOS, Android) Pricing: 20 min free trial, $20–29/month (depending on duration and specific geography)

We’d love your feedback — on the tech, the UX, or what you’d wish from a tool like this. Thanks!

Show context
iandanforth ◴[] No.44388789[source]
Alright, having tried this with Japanese I can say it's frustrating. As a near complete beginner the tutor kept speaking in Japanese even when I said "sorry I don't understand" repeatedly and then when I asked it to start in English and then gradually transition to Japanese it lasted all of one sentence in English before switching back. I can totally see how this would be useful conversation practice if you've progressed that far, but I'd love to have something for even earlier beginners. Also since many of the models you use are natively multi modal this could readily integrate visual media for discussion and grounding.

Also, for the transcription it would be great to get pure romanji to start with!

replies(2): >>44388888 #>>44389062 #
antonaf ◴[] No.44388888[source]
Yes, I can understand and empathize with your experience. Quite honestly our current focus is more for B1+ students. That 0 -> 1 / bootstrapping of the language is much better served by traditional material that is less talking / listening-heavy.
replies(3): >>44389209 #>>44390141 #>>44396663 #
iandanforth ◴[] No.44390141[source]
This is demonstrably false. Natural language acquisition is almost entirely listening and talking. The fastest and most consistently effective way to learn a language is immersion. The reason traditional material doesn't attempt immersive techniques is because it is much much easier to print a static book than it is to produce interactive and adaptive content.

The promise and potential of LLM based language learning apps is that you can cross that gap to full immersion in a way that has never been possible before.

Please be more ambitious.

replies(5): >>44390392 #>>44391453 #>>44393488 #>>44395263 #>>44396469 #
1. thaumasiotes ◴[] No.44391453[source]
> The reason traditional material doesn't attempt immersive techniques is because it is much much easier to print a static book than it is to produce interactive and adaptive content.

No, that's not correct.

First off, you can provide immersion with static books. A common favorite here on HN is Lingua Latina per se illustrata ["the Latin tongue explained by itself"].

Second off, there are two reasons that traditional material doesn't do this. The biggest one is student demand; people are afraid of immersion. The second is that the traditional approach is faster. It's lower quality, and it tops out well below the level you hope to reach, but it's faster, not slower. It takes babies a year to learn to say they're hungry. It takes an elementary school class studying a foreign language less than a day.

replies(1): >>44392396 #
2. ◴[] No.44392396[source]