Most active commenters
  • starfallg(3)

←back to thread

1080 points antipaul | 13 comments | | HN request time: 1.426s | source | bottom
Show context
mcintyre1994 ◴[] No.25067338[source]
> The M1 chip, which belongs to a MacBook Air with 8GB RAM, features a single-core score of 1687 and a multi-core score of 7433. According to the benchmark, the M1 has a 3.2GHz base frequency.

> The Mac mini with M1 chip that was benchmarked earned a single-core score of 1682 and a multi-core score of 7067.

> Update: There's also a benchmark for the 13-inch MacBook Pro with M1 chip and 16GB RAM that has a single-core score of 1714 and a multi-core score of 6802. Like the MacBook Air , it has a 3.2GHz base frequency.

So single core we have: Air 1687, Mini 1682, Pro 1714

And multi core we have: Air 7433, Mini 7067, Pro 6802

I’m not sure what to make of these scores, but it seems wrong that the Mini and Pro significantly underperform the Air in multi core. I find it hard to imagine this benchmark is going to be representative of actual usage given the way the products are positioned, which makes it hard to know how seriously to take the comparisons to other products too.

> When compared to existing devices, the M1 chip in the MacBook Air outperforms all iOS devices. For comparison's sake, the iPhone 12 Pro earned a single-core score of 1584 and a multi-core score of 3898, while the highest ranked iOS device on Geekbench's charts, the A14 iPad Air, earned a single-core score of 1585 and a multi-core score of 4647.

This seems a bit odd too - the A14 iPad Air outperforms all iPad Pro devices?

replies(14): >>25067412 #>>25067414 #>>25067435 #>>25067467 #>>25067719 #>>25067879 #>>25067931 #>>25068427 #>>25068698 #>>25068977 #>>25069217 #>>25069354 #>>25070019 #>>25071266 #
1. simonh ◴[] No.25067435[source]
It may be possible the variations are due to differences in the thermal environment when the tests were conducted. I would expect the pro and mini to beat the air as they should have better thermals, but that may only show up over longer term tests and environmental factors could win out in shorter tests. Just a theory.
replies(1): >>25068009 #
2. joking ◴[] No.25068009[source]
if I recall correctly, the geekbench score does run on small bursts and it's designed to find the peak performance without taking the thermal limitations in account.
replies(2): >>25068191 #>>25069347 #
3. starfallg ◴[] No.25068191[source]
Hence why Cinebench is often used these days when evaluating real-world performance with sustained workloads.
replies(2): >>25069340 #>>25071195 #
4. reaperducer ◴[] No.25069340{3}[source]
Different tests. Different purposes.

GB deliberately avoids running up the heat because it is focused on testing the chip, not the machine's cooling ability.

Cinebench, as you say, tests "real-world" conditions, meaning the entire machine, not just the chip.

replies(2): >>25069798 #>>25072965 #
5. GeekyBear ◴[] No.25069347[source]
SPEC, on the other hand, takes hours to run.

Of course the iPhone chip isn't as beefy as the M1, but the results still speak for themselves.

https://www.anandtech.com/show/16226/apple-silicon-m1-a14-de...

replies(1): >>25100016 #
6. starfallg ◴[] No.25069798{4}[source]
The chip's ability to run at sustained load is a part of its design also. Precisely because modern chips has to throttle in order to meet power and thermal envelopes, we should be looking at sustained performance as a more accurate measure.

In a majority of cases, burst performance only affects things like responsiveness, and those things should be measured instead for a better reflection of the benefits.

replies(1): >>25070740 #
7. adolph ◴[] No.25070740{5}[source]
If you perform an integrated test, would you not perform unit tests? An unit test may show areas for easy improvement if other aspects of the total package are changed.

For example, if someone thought M1 was thermally constrained, they might decide to rip mini out of the case and attach a different cooling method.

replies(2): >>25072997 #>>25075394 #
8. officeplant ◴[] No.25071195{3}[source]
The new R23 release even does multiple runs by default. Excitedly waiting for results for the M1 to start popping up now that its released and has support.
9. gowld ◴[] No.25072965{4}[source]
That's not true at all about Geekbench.

"Geekbench 5 is a cross-platform benchmark that measures your system's performance with the press of a button. How will your mobile device or desktop computer perform when push comes to crunch? How will it compare to the newest devices on the market? Find out today with Geekbench 5"

replies(1): >>25073774 #
10. gowld ◴[] No.25072997{6}[source]
If you run only unit tests, you don't get useful data.

> they might decide to rip mini out of the case and attach a different cooling method.

99% of customers will never do this.

11. johnmaguire2013 ◴[] No.25073774{5}[source]
I don't see anything in this quote that discounts the parent.
12. starfallg ◴[] No.25075394{6}[source]
Not saying that burst performance shouldn't be measured, but it shouldn't be the de-facto go-to performance measure like it is now with geekbench.
13. vaxman ◴[] No.25100016{3}[source]
Apple has since explained that M1s are slightly different between the Air, Pro and Mini, accounting for the different thermal chassis. (In the case of the Pro they enable an 8th GPU core.) It sounds like they are three different chips rather than the same chip in different configurations --I think he said that in marketing speak. https://www.youtube.com/watch?v=2lK0ySxQyrs

Apple makes it clearer that in the real world, these machines are only going to offer their incredible performance on Metal, iPad/iPhone apps and for any Mac apps that happen to have been ported over to M1 by their developers (using Xcode). These machines will only offer similar performance to existing Intel Macs when running existing Intel Mac apps because the incredible performance will be reserved for Apple's Rosetta2 software to make those unmodified apps compatible.

But what went unsaid, except during the part where they say they 'learned from their experience in the past processor transitions', is that by introducing the chip at the low-end of the lineup first, they create a market for the (few remaining relevant) Mac developers to invest in porting their code over to ARM and likewise, because these new machines run iPad apps at full speed on upto 6K displays, there is incentive for the iPad/iOS-only devs to expand the functionality beyond what their wares can do on a tablet/phone. (Any Mac dev that drags their feet porting may find that there are 50 iPad apps that now run fullscreen performing 75% of their functionality, costing them sales in the big volume accounts where they buy licenses by the thousands.) Meanwhile, the type of users who can get by with two USB ports, 16GB of RAM and a single external monitor probably don't run many third-party Mac apps and are going to have an awesome experience with the iPad apps and Apple's native apps.