PDA

View Full Version : How Many Android OEMs Cheat Benchmark Scores? Pretty Much All of Them



wraggster
October 5th, 2013, 10:25
After Samsung got caught out cheating on benchmarks (Note 3 (http://arstechnica.com/gadgets/2013/10/galaxy-note-3s-benchmarking-adjustments-inflate-scores-by-up-to-20/), Galaxy S4 (http://www.anandtech.com/show/7187/looking-at-cpugpu-benchmark-optimizations-galaxy-s-4)) AnandTech has done a detailed analysis of the state of benchmark cheating amongst Android OEMs (http://www.anandtech.com/show/7384/state-of-cheating-in-android-benchmarks). With the exception of Motorola, literally every single OEM they've looked at ships (or has shipped) at least one device that does benchmark-specific CPU optimizations. AnandTech also thinks it will get worse before it gets better. 'The hilarious part of all of this is we’re still talking about small gains in performance. The impact on our CPU tests is 0 - 5%, and somewhere south of 10% on our GPU benchmarks as far as we can tell. I can't stress enough that it would be far less painful for the OEMs to just stop this nonsense and instead demand better performance/power efficiency from their silicon vendors.' The article notes that Apple doesn't do any of the frequency gaming stuff.

http://mobile.slashdot.org/story/13/10/04/1227200/how-many-android-oems-cheat-benchmark-scores-pretty-much-all-of-them