←back to thread

Ask HN: Why aren't AIs being used as app beta testers yet?

14 points amichail | 4 comments | 27 Jun 25 14:09 UTC | HN request time: 0.838s | source

For example, why don't beta testing services such as TestFlight have ChatGPT as a possible beta tester along with the human testers?
1. aristofun ◴[27 Jun 25 15:10 UTC] No.44397390[source]▶
Because for meaningful tests of an app (assuming b2c or b2b for end users) you are supposed to be or imitate a human being.

Current AI is not even designed to do that. It is just a very sophisticated auto-complete.

It is sophisticated enough to fool some VCs that you can chop your round peg into square hole. But there is no ground to expect a scalable solution.

replies(1): >>44400936 #
2. gametorch ◴[27 Jun 25 22:39 UTC] No.44400936[source]▶
Eh, I disagree. Lots of valuable open source code purely written by AI has already been shipped.
replies(1): >>44402428 #
3. aristofun ◴[28 Jun 25 05:10 UTC] No.44402428[source]▶
Give me 1 decent example of code "purely" written by AI
replies(1): >>44405502 #
4. gametorch ◴[28 Jun 25 15:41 UTC] No.44405502{3}[source]▶
https://github.com/gametorch/image_to_pixel_art_wasm

Thousands of users. 40+ GitHub stars. Original draft took 30 minutes. Added numerous feature requests and each took like 5 minutes a pop.

I never wrote a single line of that code.

Furthermore, my startup, https://gametorch.app/ has 110 sign ups, paying users, millions of impressions. Never wrote any of that code either. Typing it out at ~100 wpm is far too slow.