- iPhone SDK: Interface Builder added; WebKit kicks into overdrive
- iPhone 2.0: Safari hosts local apps; SQL on a smartphone!; go get Safari 3.1 now
- New iPhone enterprise developer program, $299; musings about iPhone app licensing
- iPhone/iPod touch Q & A
- Apple's iPhone software strategy moves me
- Apple distributes 3rd-party apps through AppStore and iTunes; how developers can get it
- iPhone native SDK opens Apple's own dev tools to public
- iPhone gets Exchange support, aims for BlackBerry
- On the demise of Xserve RAID
- 10.5.2 update: Way more than security, and Apple fixed Stacks
January 10, 2006 | Comments: (0)
The Mac performance shell game
Apple has bought itself another controversy, and once again, needlessly. It's not exactly a dark cloud over the announcements of its new machines, but it'll be a topic of conversation here and elsewhere, and an issue for which Apple will have to answer.
In short, Apple used multiprocessor benchmarks to skew the performance advantage that its Intel-based machines enjoy compared to single-core PowerPC G4 and G5. Apple used the industry-standard SPEC suite components SPECint2000 and SPECfp2000, but here's the catch: Apple used SPECint_rate2000 and SPECfp_rate2000. Both tests spawn multiple parallel benchmark processes and are specifically intended for comparing multiprocessor systems. Single CPU, or single-core machines do positively lousy on SPEC*_rate2000 tests. That's predictable and universally understood. Add a second CPU or a second core and, as you would expect, SPEC*_rate2000 performance on any multiprocessor-optimized test skyrockets compared to a single-processor box.
Apple uses SPEC*_rate2000 tests as a foundation for claims that Intel-based Macs outperform PowerPC G4 and G5 by a factor of 2 to 5. Well, yeah. A dual-core anything outperforms a single-core anything else by a factor of 2 to 5 in benchmark tests that make use of multiple threads or processes, tests crafted specifically for the purpose of stressing SMP-based systems. It's murky marketing, and the sad part is that Apple didn't have to resort to it to make Apple's PowerPC-to-Intel switch look like a smart one. Mac users have no choice, and users also know more or less what to expect performance-wise.
I wish I didn't have to bring this out. I'm no less excited about the new Intel-based Macs and Apple's updated creative and productivity apps. But I can't let questionable benchmarks get by; I serve readers, not Apple.
When Apple responds, I will share that complete response with you.
Posted by Tom Yager on January 10, 2006 11:25 AM
RATE THIS ARTICLE:
-
- COMMENTS
