BenchmarkXPRT Blog banner

Category: Android

Welcome to 2015

Happy 2015! We hope that you all had a wonderful holiday season. I certainly did.

Back at the beginning of December, we talked about an intermittent problem that BatteryXPRT was having on the Nexus 9. We fixed the problem shortly after that, but delayed the release to test it on Android 5.01. The testing is complete, and we’ll be releasing BatteryXPRT 2014 v102 next week. As before, it will be available from Google Play and from the BatteryXPRT.com page.

In the last blog post, we recapped come of the highlights of 2014. Moving forward into 2015, WebXPRT 2015 is in development and we’re thinking ahead to the next version of MobileXPRT.  We’ll be at Mobile World Congress in March, and at IDF China in April. We’ll tell you about our plans for those conferences over the next few weeks. If you’re planning to be at either of those shows, let us know! We’d love to talk to you.

We’re also planning some exciting new things in 2015. We can’t talk about them yet, but, personally, I can’t wait!

Wishing you all the best in the New Year!

Eric

Comment on this post in the forums

The busiest year ever!

As 2014 winds down, it’s a good time to look back at the year. And what a year it has been! This is the year that the XPRTs really went global. The benchmarks are in wider use than ever. The community continues to grow.

Here are a few of the big things that happened this year:

 

It’s going to be hard to top this year, but we are certainly going to try! There’s another video coming soon. We’re already working on WebXPRT 2015. (If you haven’t commented on the WebXPRT 2015 design document yet, it’s not too late.) We’re making plans for MWC 2015. And there’s a lot more in the works!

Whatever your traditions are, we hope you have a wonderful holiday season. See you in 2015.

Eric

Timing is everything

We have a couple instances of interesting timing this week.

A few weeks ago, we released the second community preview for CrXPRT (CP2).  It’s been doing very well and we’re planning to release CrXPRT to the public next week. Many thanks to all the community members who have helped make this possible.

Because the release is so close to the end of the year, the general release will be CrXPRT 2015. However, the community previews were dated 2014, which is potentially confusing. We want to reassure you that the results will still be comparable. As we discussed last week, for any of the XPRT benchmarks, the results from the community previews are always comparable to those from the final release.

In other news, we fixed the intermittent problem BatteryXPRT was having on the Nexus 9. The tests are looking good. In a bit of really good timing, this week Google started rolling out Android 5.01. We will be going back and retesting the devices with the newer version of the OS. We don’t expect any new problems, but it’s very nice that we got to check it out before we released the patch.

Eric

Comment on this post in the forums

A very good question

A couple of weeks ago, we released the second community preview of CrXPRT (CP2). One of the changes was to make CrXPRT handle its test results more like WebXPRT. It now automatically uploads some test data to the PT servers, so that we can use it to improve future versions of the benchmark. Like WebXPRT, no personally identifying information is collected, and the results are never made public without your permission.

This week we got a question about the new results collection in CP2. The member wanted to know if the uploading of the results affected the battery life score at all. It does not. The results collection happens after the test. If you’re doing a battery rundown test, the results aren’t uploaded until the device boots the next time. I’m sorry we didn’t make that clearer in the documentation.

When we release a community preview, we commit that the results from that preview will be comparable to any subsequent previews and to the general release. In the case of CP2, we compared the results from CP2 to those from CP1 to make sure that the results stayed comparable. We take this commitment very seriously. When you test with a community preview, you can be sure that the results will still be good when the general release comes out.

In other news, we released a patch for BatteryXPRT yesterday. As we explained in the last blog post, this new version of BatteryXPRT is much more stable on devices running Android 5.

Have any other good questions? Send them our way.

Eric

Comment on this post in the forums

An updated BatteryXPRT 2014 for Android build is available

Today we’re releasing a new build of BatteryXPRT 2014 for Android (v101) at BatteryXPRT.com and the Google Play store. This build addresses issues we saw with the Create Slideshow Workload when testing on Android 5 devices. The tests have not changed, so new scores are comparable with previous BatteryXPRT scores.

Although the patch works on the majority of Android 5 devices, we are continuing to investigate intermittent failures on the Nexus 9. Please see the Monday’s blog post, for details.

Click here to download the new BatteryXPRT installer (317 MB) directly from our site.

For users who have limited bandwidth or trouble accessing the Google Play store, downloading the APK files (16.9 MB total) may make installation easier.

Download the updated BatteryXPRT APK (2.7 MB) directly from our site.

Download the updated BatteryXPRT Tests APK (14.2 MB) directly from our site.

If you have any questions about the update or any other XPRT-related topic, feel free to contact us at BenchmarkXPRTsupport@principledtechnologies.com.

Comment on this post in the forums

An update for BatteryXPRT 2014 for Android

For those of you in the US, I hope you had a happy Thanksgiving.

A couple of weeks ago, we updated MobileXPRT so that it would run correctly on Android 5 (Android L) devices. Later this week, we will be updating BatteryXPRT as well. The current BatteryXPRT build doesn’t work with Android 5 due to failures of the Create Slideshow workload. This is the same workload failure we fixed with an updated MobileXPRT build.

The new build greatly improves things. We successfully tested the new build on an array of Android 5 and 4.4 devices with no failures. However, we have seen the new build of BatteryXPRT return intermittent errors during the Create Photo Collage and Apply Photo Effects workloads when testing on the Nexus 9.

Because the error on the Nexus 9 is intermittent, it’s possible to get results from some runs. These results are still valid.

We haven’t seen this failure on any device other than the Nexus 9, but cannot guarantee that there aren’t others. If you see any other failures, or have any questions, please contact us.

We’re currently working on a solution for this problem. We will, as always, keep you informed.

Eric

Comment on this post in the forums

Check out the other XPRTs:

Forgot your password?