←back to thread

Ask HN: Why aren't AIs being used as app beta testers yet?

14 points amichail | 3 comments | 27 Jun 25 14:09 UTC | HN request time: 0.696s | source

For example, why don't beta testing services such as TestFlight have ChatGPT as a possible beta tester along with the human testers?
1. duxup ◴[27 Jun 25 14:16 UTC] No.44396974[source]▶
I'm going to throw out my own ignorant theory.

AIs that I find useful are still just LLMs and LLMs power comes from having a massive amount of text to work with to string together word math and come up with something ok. That's a lot of data that comes together to get things ... kinda right... sometimes.

I don't think there's that data set for "use an app" yet.

We've seen from "AI plays games" efforts that there have been some pretty spectacular failures. It seems like "use app" is a different problem.

replies(1): >>44398895 #
2. cheevly ◴[27 Jun 25 18:03 UTC] No.44398895[source]▶
LLMs have literally won Pokemon. Im pretty sure that using an app is 10x simpler.
replies(1): >>44399044 #
3. Vilian ◴[27 Jun 25 18:23 UTC] No.44399044[source]▶
A lot simpler to run pokemon than test an app, the game play by itself sometimes