Does the photo recognition attempt to carb count what it sees? Is that even possible? My son is a T1D and he still struggles with carb counting.
replies(3):
I’m Joshua, a student, and I’m excited (and a little nervous) to share something deeply personal that I’ve been working on: Islet, my diabetes management app powered by GPT-4o-mini. It’s now on the App Store, but I want to be upfront—it’s still very much in its early stages, with a lot more to go.
I was diagnosed with Type 1 diabetes while rowing competitively, and that moment changed everything. It wasn’t just the practical challenges of managing insulin, carb counts, and blood sugars; it fundamentally shifted how I see myself and the world. It forced me to slow down, prioritise my health, and take control in ways I never had to before. My outlook on life became more focused on resilience, adaptability, and finding solutions to problems that truly matter.
This app started as a pet project over the summer, a way to see what I could create using ChatGPT and explore the potential of LLMs to help with real-world challenges. At first, it was just about making my own diabetes management easier—understanding patterns in blood sugars, planning meals, and adjusting routines. But as I worked on it, I realised it could do more.
Right now, Islet offers personalised meal suggestions, tracks activity, and provides basic insights based on the data you enter. It’s far from complete. Even so, the process of building Islet has already taught me so much about how powerful AI can be in creating personal, meaningful tools.
This project is deeply tied to how my diagnosis changed me. It’s about more than managing diabetes, it’s about showing how anyone, even a student experimenting over the summer, can use AI to potentially solve real, personal problems. I believe tools like LLMs have the power to democratise solutions for all, making life just a bit easier for all of us.
If you’re curious, you can check it out here: https://apps.apple.com/gb/app/islet-diabetes/id6453168642. I’d love to hear your thoughts what works, what doesn’t, and what features you think would make it better. Your input could help shape the next steps for Islet.
Thanks for reading !
joshua
Pizza is a good example of why not. Slices come in very different sizes, sauces have very different carb content, so do crusts, and toppings.
Edit: for example this pizza(1) is 31g per slice and this pizza(2) is 73g per slice. The difference is very meaningful and the “general idea” given by photo recognition would likely be wrong to the point of dangerous for a diabetic in both cases.
If you’re looking for software that can make a guess simply for the sake of generating a number to write down and not be used in any way, a random number generator would be safer since the risk of output being misconstrued as actual information is much lower.
1 https://www.costcobusinessdelivery.com/kirkland-signature-ca...
The people that make the label make the food. They know what they put in it. Because they made it. They wrote down what they put in it for you to read and make decisions off of. The difference is categorical.
Then I calculate how much my serving contains.
Depending on what you eat, what type of diabetes you have and how it’s treated you may have to consider the amount of protein and fat as well (they slow digestion and cause a delayed rise in blood sugar levels). If you have an insulin pump you may want to program a delayed insulin dose to handle that.
Sounds complicated? It is, but only during the first weeks. You quickly learn the carbs content of the food you frequently eat and learn to estimate how much is on your plate. Like, two units for a bun. There are also great nutrition apps out there that help a lot.
Of course if you eat a Neapolitan pizza with not that much of cheese everything changes again. And YMMV, I'm just talking about my experiences.