←back to thread

165 points distalx | 2 comments | | HN request time: 0.001s | source
Show context
hy555 ◴[] No.43947151[source]
Throwaway account. My ex partner was involved in a study which said these things were not ok. They were paid not to publish by an undisclosed party. That's how bad it has got.

Edit: the study compared therapist outcomes to AI outcomes to placebo outcomes. Therapists in this field performed slightly better than placebo, which is pretty terrible. The AI outcomes performed much worse than placebo which is very terrible.

replies(9): >>43947337 #>>43947376 #>>43947393 #>>43948478 #>>43948522 #>>43948984 #>>43949480 #>>43949609 #>>43950587 #
ilaksh ◴[] No.43948522[source]
Which model exactly? What type of therapy/prompt? Was it a completely dated model, like in the article where they talk about a model from two years ago? We have had massive progress in two years.
replies(1): >>43948862 #
raverbashing ◴[] No.43948862[source]
Honestly none of the companies are tuning their model to be better at therapy.

Also it is not expected that the training material for the model deals with the actual practical aspects of therapy, only some of the theoretical aspects are probably in that material

replies(2): >>43949136 #>>43949482 #
1. jdietrich ◴[] No.43949482[source]
>none of the companies are tuning their model to be better at therapy

BrickLabs have developed an expert-fine-tuned model specifically to provide psychotherapy. Their model has shown modestly positive results in a reasonably large preregistered RCT.

https://trytherabot.com/

https://ai.nejm.org/doi/full/10.1056/AIoa2400802

replies(1): >>43952032 #
2. raverbashing ◴[] No.43952032[source]
Yeah but 99% of people trying "AI mental health" are using free ChatGPT, etc