←back to thread

210 points vincirufus | 3 comments | | HN request time: 0.834s | source
1. conradev ◴[] No.45148426[source]
The graphs that some of these companies make are brutal: https://docs.z.ai/guides/llm/glm-4.5#higher-parameter-effici...

"So, we only know the Y-axis for some models in the scatter plot. Let's make up an X-axis value on the bad side of the graph and include the data points anyway."

Visually disingenuous!

replies(1): >>45148441 #
2. croemer ◴[] No.45148441[source]
Which x axis was made up? You mean showing barplots in descending order of scores?
replies(1): >>45151849 #
3. conradev ◴[] No.45151849[source]
No, the scatter plot on parameter efficiency!

“Model Parameters (B)” has an “Unknown” column to the right of 1000, implying those models are 1200B or more parameters, which is just not the case.

It renders the comparison useless, they can really only claim best efficiency against other open weight models.