←back to thread

Ask HN: Why aren't AIs being used as app beta testers yet?

14 points amichail | 6 comments | 27 Jun 25 14:09 UTC | HN request time: 0.426s | source | bottom

For example, why don't beta testing services such as TestFlight have ChatGPT as a possible beta tester along with the human testers?

1. HeyLaughingBoy ◴[27 Jun 25 17:25 UTC] No.44398609[source]▶

>>44396933 (OP) #

Anecdotally, I know someone who tried to have ChatGPT generate unit tests and it was an abject failure.

replies(4): >>44398885 #>>44400555 #>>44400570 #>>44400926 #

2. cheevly ◴[27 Jun 25 18:02 UTC] No.44398885[source]▶

>>44398609 (TP) #

I know someone that generated unit tests successfully.

replies(1): >>44399079 #

3. whoknowsidont ◴[27 Jun 25 18:28 UTC] No.44399079[source]▶

And I know exactly which one of these is an enterprise B2B app/platform.

4. haiku2077 ◴[27 Jun 25 21:50 UTC] No.44400555[source]▶

>>44398609 (TP) #

I generate tests with Claude almost every day.

5. owebmaster ◴[27 Jun 25 21:52 UTC] No.44400570[source]▶

>>44398609 (TP) #

I have generated unit tests successfully, how did the someone you know failed?

6. gametorch ◴[27 Jun 25 22:38 UTC] No.44400926[source]▶

>>44398609 (TP) #

I generated tons of valuable code with a bunch of GitHub stars, paying users, hundreds of signups, millions of impressions. Just chipping in my anecdote.