←back to thread

LLM Hallucinations in Practical Code Generation

(dl.acm.org)
65 points appwiz | 1 comments | 23 Jun 25 07:14 UTC | HN request time: 0.205s | source
Show context
nerdjon ◴[26 Jun 25 00:09 UTC] No.44383011[source]▶
My favorite is trying to use it to generate an IAM policy and keys are just hallucinated based on expectations of what the keys would be called and are either wrong or they flat out don't exist if you are dealing with more advanced conditions.
replies(1): >>44383785 #
1. mikeocool ◴[26 Jun 25 02:42 UTC] No.44383785[source]▶
> keys are just hallucinated based on expectations of what the keys would be called and are either wrong or they flat out don't exist

To be fair this is also how I generally try to write IAM configs without AI.