BenchmarkXPRT Blog banner

Author Archives: Justin Greene

Seeing the whole picture

In past posts, we’ve discussed how people tend to focus on hardware differences when comparing performance or battery life scores between systems, but software factors such as OS version, choice of browser, and background activity often influence benchmark results on multiple levels.

For example, AnandTech recently published an article explaining how a decision by Google Chrome developers to increase Web page rendering times may have introduced a tradeoff between performance and battery life. To increase performance, Chrome asks Windows to use 1ms interrupt timings instead of the default 15.6ms timing. Unlike other applications that wait for the default timing, Chrome ends up getting its work done more often.

The tradeoff for that increased performance is that waking up the OS more frequently can diminish the effectiveness of a system’s innate power-saving attributes, such as a tick-less kernel and timer coalescing in Windows 8, or efficiency innovations in a new chip architecture. In this case, because of the OS-level interactions between Chrome and Windows, a faster browser could end up having a greater impact on battery life than might initially be suspected.

The article discusses the limitations of their test in detail, specifically with regards to Chrome 36 not being able to natively support the same HiDPI resolution as the other browsers, but the point we’re drawing out here is that accurate testing involves taking all relevant factors into consideration. People are used to the idea that changing browsers may impact Web performance, but not so much is said about a browser’s impact on battery life.

Justin

Comment on this post in the forums

Looking for a bargain?

There are many benefits to being a member of the community: the XPRT community previews, the source code for the benchmarks, the monthly newsletter, and more. To join the community, all you’ve had to do up until now is sign up and pay a one-time $20 fee. Our goal with the fee was to make sure that people who joined were serious.

Today, we’re announcing a change. We recognize that, for some companies, getting that $20 fee reimbursed can be a hassle. So, if you work for a device maker, OEM, chip manufacturer, or retailer, you’ll be able to join the community for free.

Here’s how it works: Simply fill out the form, use your company e-mail address, and click the option to be considered for a free membership. We’ll send you an email within one business day to verify the address is real and then activate your membership.

Simple, right?

Justin

Comment on this post in the forums

An HDXPRT 2014 update

After the HDXPRT 2014 release last week, we discovered a new issue. During installation, if network connections were active, Windows SmartScreen would pop up with a message that said, “Windows SmartScreen prevented an unrecognized app from starting…” If network connections were disabled, a popup would say, “Windows SmartScreen can’t be reached right now.”

Even after turning off SmartScreen entirely, we continued to receive Windows publisher verification warnings. It turns out that the problem relates to testing on a system where Windows 8/8.1 is reinstalled over an existing copy of the OS. Residual information in the C:\Windows.old files apparently trigger the warning. It may also occur if you upgraded from Windows 8 or 8.1 Preview to Windows 8.1.

You may not encounter this problem at all during testing. If you do, there are at least three options for dealing with this. The first option is to turn off SmartScreen in the Windows Action center and disable Windows prompts about publisher verification. Then, open Internet Explorer – Internet Options, click the Security tab, click the Custom level button, and scroll down to select Enable Launching applications and unsafe files.

Screenshot (2)

The second option is to delete any Windows.old files. You can find instructions for that here.

The third is to test on a completely fresh OS install on a reformatted drive.

Also, today we’re posting an updated build that fixes a few UI issues. Scores from the original build are still valid and comparable.

If you have any feedback or questions regarding HDXPRT 2014, feel free to send us a message at BenchmarkXPRTsupport@principledtechnologies.com.

Justin

Comment on this post in the forums

Check out the other XPRTs:

Forgot your password?