Category: Battery life

It makes a difference

on July 3, 2014

Ars Technica reported this week that they tested the developer preview of Android L and saw a whopping 36 percent improvement in battery life! Google made improving battery life a priority, and it sounds like they are succeeding. I can’t wait to test Android L with BatteryXPRT.

This is a spectacular example of how a change in software can change benchmark results, but it’s hardly unique. I’ve written before about how background activity on a phone depressed my friend’s WebXPRT scores. AnandTech used both IE 11 and Chrome 30 to test the Surface Pro 2 with a variety of benchmarks, including WebXPRT, SunSpider, Octane, Browsermark, and others. Browser choice had a noticeable impact on results – about a 40 percent difference for WebXPRT and a 76 percent difference for SunSpider!

People are generally pretty aware that changing the hardware changes performance. However, sometimes they lose track of software differences. When you compare scores, it’s not always possible to keep all the variables the same, but it’s crucial to know what the differences are.

In other BenchmarkXPRT news, we’re making some final adjustments to HDXPRT 2014, and the general release is just around the corner.

Eric

Comment on this post in the forums

Posted in Android, Battery life, HDXPRT 2014, Performance benchmarking, Performance testing on tablets, WebXPRT |

Testing the waters

By Eric Hale

on June 19, 2014

A couple of weeks ago, we talked about some of our ideas for a new XPRT designed for Google’s Chrome OS. We’ve been working with some of these ideas and, while we’re still in the experimental stage, things look promising so far.

As we mentioned in the earlier blog, we’re trying WebXPRT as a base for the performance part of the test. So far, the performance component is working well. In addition to modified WebXPRT tests, we’re also trying some things that are not part of the WebXPRT 2013 workload.

We’ve been able to get battery life, but it’s been challenging and we haven’t found a way to avoid using Chrome’s Developer Mode. Accessing Developer Mode in Chrome can be tricky and requires different steps for each hardware manufacturer. We’re hoping to find ways to make battery life testing easier.

I’ve been vague about the tests because they’re likely to change over the next few weeks. We’re experimenting with both browser-based and Native Client-based performance tasks. As they firm up, I’ll be able to share more information.

Challenges aside, we’re excited about this new benchmark, and committed to making it as effective as possible. We’d still love feedback on a name, so feel free to contact us at BenchmarkXPRTsupport@principledtechnologies.com with your ideas.

Eric

Comment on this post in the forums

Posted in Battery life, Chrome OS, Collaborative benchmark development, Performance benchmarking, What makes a good benchmark? |

BatteryXPRT 2014 for Android is here!

By Eric Hale

on May 2, 2014

Today we formally released BatteryXPRT 2014 for Android. The BenchmarkXPRT Development Community has been using a community preview for several weeks and now that we’ve released the benchmark, anyone may freely use it.

Also, the BatteryXPRT 2014 for Android source will soon be available to the community. Remember that community members have access to the source, but it is not available to the general public.

Comment on this post in the forums

Posted in Android, Battery life, BatteryXPRT 2014 for Android, BenchmarkXPRT development community |

It’s show time!

By Eric Hale

on May 1, 2014

Tomorrow is the big day for BatteryXPRT 2014 for Android. After months of development, it’s finally time to release it to the world. We’ve learned quite a bit throughout the process, and we expect BatteryXPRT to become a trusted tool for Android users around the world.

BatteryXPRT will be available for download at BatteryXPRT.com, or through the Google Play Store. It will be available to the public no later than 5:00 PM ET on Friday May 2.

The BatteryXPRT results page allows you to submit test results directly from the app. We hope you’ll use this feature to submit your test runs for publication in the database.

There’s a huge diversity of Android devices out there, so BatteryXPRT.com will link to a page of tips, tricks, and known issues that we compiled during development testing. As with any of the XPRTs, if you encounter any issues please let us know.

Along with the new app, we also invite you to check out the Exploring BatteryXPRT 2014 for Android white paper for a more in-depth discussion of how it all works.

It’s definitely BatteryXPRT’s time to shine, but don’t forget that the new and improved TouchXPRT is coming soon!

Eric

Comment on this post in the forums

Posted in Android, Application-based benchmarks, Battery life, BatteryXPRT 2014 for Android, TouchXPRT 2014, White papers |

It’s all in the presentation

By Eric Hale

on April 24, 2014

The comment period for BatteryXPRT CP2 ended on Monday. Now we are in the final sprint to release the benchmark.

The extensive testing we’ve been doing has meant that we’ve been staring at a lot of numbers. This has led us to make a change in how we present the results. As you would expect, the battery life when you’re running the test using Wi-Fi is different than when you’re running it using your cellular network. Although individual devices vary, the difference is in the vicinity of 10 percent, about the same as the difference between Airplane mode and using Wi-Fi.

BatteryXPRT has always captured a device’s Wi-Fi setting in its disclosure results, but had not included this information with the results. Because we found it so helpful to have the Wi-Fi setting alongside the results, we have changed the presentation of the results to recognize three modes: Airplane, Wi-Fi, and Cellular. We hope that this will avoid confusion as people are using BatteryXPRT.

Note that we have not changed the way the results are calculated. Results you generated during the preview are still valid. However, results from one mode should not be compared to results from another mode.

We’ve been talking a lot about BatteryXPRT, but TouchXPRT is also looking great! We’re looking forward to releasing both of them soon!

Eric

Comment on this post in the forums

Posted in Android, Battery life, BatteryXPRT 2014 for Android, Benchmark metrics, TouchXPRT 2014 |

Greasing the track

By Eric Hale

on March 20, 2014

While BatteryXPRT 2014 for Android may still be in its community preview stage, we’re already looking for the next great XPRT. As we’ve said in the past, there’s always something new to measure. That’s where you come in − we want to hear about the benchmarks you want to see!

To make it easier for Community members to send us their ideas, we’ve made a form available in the member’s area. All members have to do is click Have an idea for a new XPRT? and fill in a description. This form saves you the trouble of composing an e-mail and makes it easier for us to track community interest.

However, even though we’re making life simpler for members of the community, anyone can suggest a new benchmark. If you have a good idea or any other comments you want us to hear, just send an e-mail to BenchmarkXPRTsupport@principledtechnologies.com. We also hope you’ll consider joining the community.

There’s a lot of new technology out there, and we’re very excited about upcoming possibilities. Speaking of new technology, check out Bill’s new blog, Tech Everywhere. He’s already written about electric cars, smart watches and a Bluetooth-enabled electric toothbrush. It’s definitely worth a read.

Eric

Comment on this post in the forums

Posted in Battery life, BatteryXPRT 2014 for Android, BenchmarkXPRT development community, Collaborative benchmark development, Community Preview |

Category: Battery life

It makes a difference

Testing the waters

BatteryXPRT 2014 for Android is here!

It’s show time!

It’s all in the presentation

Greasing the track

Check out the other XPRTs: