←back to thread

Use Prolog to improve LLM's reasoning

(shchegrikovich.substack.com)
379 points shchegrikovich | 1 comments | 13 Oct 24 21:22 UTC | HN request time: 0.229s | source
Show context
YeGoblynQueenne ◴[17 Oct 24 21:53 UTC] No.41874200[source]▶
That's not going to work. Garbage in - Garbage out is success-set equivalent to Garbage in - Prolog out.

Garbage is garbage and failure to reason is failure to reason no matter the language. If your LLM can't translate your problem to a Prolog program that solves your problem- Prolog can't solve your problem.

replies(3): >>41874322 #>>41875551 #>>41876345 #
Philpax ◴[17 Oct 24 22:10 UTC] No.41874322[source]▶
This is a shallow critique that does not engage with the core idea. Specifying the problem is not the same as solving the problem.
replies(2): >>41874902 #>>41880822 #
1. sgdfhijfgsdfgds ◴[18 Oct 24 16:17 UTC] No.41880822[source]▶
It's actually pretty concise: Prolog isn't all that easy! That's why people don't use it.

Competent CS students fail Prolog courses all the time. A lot of Prolog on the internet will either be wrong, or it will be so riddled with unnecessary/unclear backtracking that an LLM won't be able to make more sense of it than it does words.