BenchmarkXPRT Development Community Blog

TouchXPRT 2014 is almost here

on May 8, 2014

We’re excited to say that TouchXPRT 2014 will launch within the next few days. TouchXPRT 2014 includes a completely new UI, updated component tests, improved disclosure information, improved automation, and the ability to submit results directly from the app.

TouchXPRT 2014 also addresses the number-one request we got about TouchXPRT 2013—to make it more obvious how to run all the tests. In TouchXPRT 2013, users had to choose the Run All button from the hidden Charms menu to run all of the tests and produce an overall score. In TouchXPRT 2014, the Start Test button on the benchmark’s main page makes it obvious how to run all five tests at once.

After the launch, TouchXPRT will be available for download at TouchXPRT.com and through the Windows App Store.

TouchXPRT 2013 will continue to be available for a while, as we understand that labs may have tests in progress. Likewise, the TouchXPRT 2013 results database will continue to be available, but separate from the TouchXPRT 2014 results. You should never compare results for the two versions of TouchXPRT.

For a more in-depth discussion of the new benchmark, please read the Exploring TouchXPRT 2014 white paper.

We’ve been busy with the BatteryXPRT and TouchXPRT launches, but more is on the way. HDXPRT 2014 is next in line!

Eric

Comment on this post in the forums

Posted in HDXPRT 2014, TouchXPRT 2014, TouchXPRT development process, White papers, Windows 8, Windows 8.1 |

BatteryXPRT 2014 for Android is here!

By Eric Hale

on May 2, 2014

Today we formally released BatteryXPRT 2014 for Android. The BenchmarkXPRT Development Community has been using a community preview for several weeks and now that we’ve released the benchmark, anyone may freely use it.

Also, the BatteryXPRT 2014 for Android source will soon be available to the community. Remember that community members have access to the source, but it is not available to the general public.

Comment on this post in the forums

Posted in Android, Battery life, BatteryXPRT 2014 for Android, BenchmarkXPRT development community |

It’s show time!

By Eric Hale

on May 1, 2014

Tomorrow is the big day for BatteryXPRT 2014 for Android. After months of development, it’s finally time to release it to the world. We’ve learned quite a bit throughout the process, and we expect BatteryXPRT to become a trusted tool for Android users around the world.

BatteryXPRT will be available for download at BatteryXPRT.com, or through the Google Play Store. It will be available to the public no later than 5:00 PM ET on Friday May 2.

The BatteryXPRT results page allows you to submit test results directly from the app. We hope you’ll use this feature to submit your test runs for publication in the database.

There’s a huge diversity of Android devices out there, so BatteryXPRT.com will link to a page of tips, tricks, and known issues that we compiled during development testing. As with any of the XPRTs, if you encounter any issues please let us know.

Along with the new app, we also invite you to check out the Exploring BatteryXPRT 2014 for Android white paper for a more in-depth discussion of how it all works.

It’s definitely BatteryXPRT’s time to shine, but don’t forget that the new and improved TouchXPRT is coming soon!

Eric

Comment on this post in the forums

Posted in Android, Application-based benchmarks, Battery life, BatteryXPRT 2014 for Android, TouchXPRT 2014, White papers |

It’s all in the presentation

By Eric Hale

on April 24, 2014

The comment period for BatteryXPRT CP2 ended on Monday. Now we are in the final sprint to release the benchmark.

The extensive testing we’ve been doing has meant that we’ve been staring at a lot of numbers. This has led us to make a change in how we present the results. As you would expect, the battery life when you’re running the test using Wi-Fi is different than when you’re running it using your cellular network. Although individual devices vary, the difference is in the vicinity of 10 percent, about the same as the difference between Airplane mode and using Wi-Fi.

BatteryXPRT has always captured a device’s Wi-Fi setting in its disclosure results, but had not included this information with the results. Because we found it so helpful to have the Wi-Fi setting alongside the results, we have changed the presentation of the results to recognize three modes: Airplane, Wi-Fi, and Cellular. We hope that this will avoid confusion as people are using BatteryXPRT.

Note that we have not changed the way the results are calculated. Results you generated during the preview are still valid. However, results from one mode should not be compared to results from another mode.

We’ve been talking a lot about BatteryXPRT, but TouchXPRT is also looking great! We’re looking forward to releasing both of them soon!

Eric

Comment on this post in the forums

Posted in Android, Battery life, BatteryXPRT 2014 for Android, Benchmark metrics, TouchXPRT 2014 |

Looking for the next big thing

By Eric Hale

on April 17, 2014

We recently introduced a new Web form in the members’ area to make it easier for you to submit new benchmark ideas. We’ve already received some interesting suggestions:

A benchmark to assess performance, battery life, and Chrome-specific technologies on Chromebooks
A benchmark to evaluate camera features and photo quality on phones and tablets
A benchmark for measuring the performance of cloud services
A benchmark for measuring the performance and battery life of iOS-based devices

Are you interesting in seeing any of these? Or do you have an idea no one has mentioned yet? We know there’s more out there! We like finding new things to measure and new ways to measure them, so please don’t hesitate to share your ideas!

Also, remember that the comment period for BatteryXPRT 2014 for Android CP2 ends on Monday, April 21. CP2 is the first XPRT to feature a Simplified Chinese UI. Please send in your comments. We’ll be aiming for a BatteryXPRT general release soon.

By the way, if you have a language you’d like to see and you’re willing to help with the translation, we’d love to talk to you!

Let us know what you think about potential new benchmarks, language options, or anything else on your mind at BenchmarkXPRTSupport@principledtechnologies.com.

Eric

Comment on this post in the forums

Posted in BatteryXPRT 2014 for Android, Benchmarking, Chinese, Collaborative benchmark development, Community Preview, Future of performance evaluation, What makes a good benchmark? |

Password reset issue

By Eric Hale

on April 17, 2014

A couple of members had trouble resetting their passwords. Our technicians are working on a solution, but in the meantime, if you’ve encountered any problem with resetting your password, please contact us at BenchmarkXPRTsupport@principledtechnologies.com. We’ll be happy to manually reset your password and answer questions about any other concerns you may have.

Posted in BenchmarkXPRT development community |

TouchXPRT 2014 is almost here

BatteryXPRT 2014 for Android is here!

It’s show time!

It’s all in the presentation

Looking for the next big thing

Password reset issue

Check out the other XPRTs: