BenchmarkXPRT Blog banner

Category: Collaborative benchmark development

MWC is coming

As you probably know, the Mobile World Congress (MWC) starts Monday in Barcelona. Bill loves gadgets, loves Barcelona, and loves talking about technology, so he’s really looking forward to being there.

Bill’s got a lot to talk about. In January, we released the first community preview for TouchXPRT 2014. Then on February 7, 2014, we released the first community preview for a brand new benchmark: BatteryXPRT 2014 for Android. Not only that, HDXPRT and WebXPRT are in development. And he always loves to hear about new areas where you are interested in having benchmarks.

And that’s not all – If you read Bill and Mark’s post about being at CES, you’ll be happy to know that the Golden Tickets are back! The Golden Tickets let you join the community and get your device tested for free. If you’re a mobile device manufacturer, be sure to find Bill to get yours.

If you want to meet with Bill, send an e-mail to BenchmarkXPRTsupport@principledtechnologies.com. You can also DM us on Twitter at @BenchmarkXPRT.

We hope to see you there!

Eric

Comment on this post in the forums

BatteryXPRT 2014 for Android CP1

Last week we released the BatteryXPRT 2014 for Android Community Preview 1 (CP1). As I said in last week’s blog, You wanted it? You got it!, you are free to publish results from this community preview.

We hope you’ll submit results to be published in the BatteryXPRT database. You’ll find the file containing your results in the Android\data\com.batteryxprt\BatteryXPRT\results directory on the SD card of your device. The results directory will contain a time-stamped directory for each run – for example, “2014Feb11142239.” You’ll find a file named Results.xml in the appropriate time-stamped directory. To submit a result, just e-mail the Results.xml file from your run to BenchmarkXPRTsupport@principledtechnologies.com.

The benchmark includes a user manual in the UI. In addition to the benchmark itself, you can also find installation instructions and a design overview in the member’s area.

We’ll make the source code for the community preview available in the next few days.

Given the diversity and changing nature of Android devices, we expect that you may run into some issues. As with any of our community previews, if you encounter any issues, please let us know so we can continue to improve the benchmark as we prepare it for release.

Community previews are only available to community members. If you are not a member, this a great time to join.

After you’ve downloaded CP1, let us know what you think by posting to the forum or e-mailing us at BenchmarkXPRTsupport@principledtechnologies.com.

Eric

Comment on this post in the forums

BatteryXPRT 2014 for Android Community Preview 1 is available to community members!

As promised in You Wanted it? You got it!, we are releasing the BatteryXPRT 2014 for Android Community Preview 1. See Community Preview 1 is available! for the details. (login required)

If you are not a community member, it’s easy to join!

Eric

You wanted it? You got it!

As Bill said in Endurance, when we asked what new benchmark people most wanted to see, battery life was number one. Over the past few months, we’ve announced that we’re developing a battery benchmark, solicited input from the community, and have been hard at work developing BatteryXPRT 2014 for Android.

I’m happy to announce that we’re releasing BatteryXPRT 2014 for Android Community Preview 1 (CP1) later this week. CP1, as its name makes clear, is not the final BatteryXPRT 2014 for Android release. There’s still a lot of work to do on the user interface and the new results viewer. However, it’s a great way for everyone in the community to see the current state of our thinking and to provide us with feedback. You can run this version of the tool and see what you think!

As we’ve done with previous community previews, we’re also taking two more steps:

  • We’re not putting any publication restrictions on this preview release. Test at will, and publish your findings.
  • We’re releasing the source code to all community members. If you’re curious about not just what we’re doing but how we’re doing it, you can find out.

As the design document explains, BatteryXPRT 2014 for Android can estimate battery life in less than 6 hours. You can also use it as a rundown test if you prefer. In addition, CP1 is the first of our benchmarks to use the new UI design. Here’s a peek:

BatteryXPRT CP1 home screen

As you can see from the screenshot, you can run the test in Airplane mode or connected to the network. There are other cool features we’ll be talking about once CP1 is available.

We’re really excited about this one. I can’t wait!

Eric

Comment on this post in the forums

TouchXPRT CP1

This week we released the TouchXPRT 2014 Community Preview 1 (CP1). As with past community previews, the tests are stable and you may publish your results.

CP1 has a number of improvements over TouchXPRT 2013. We’ve updated the tests and used new and more demanding kinds of data. The Run All button is now prominent on the main screen, and the benchmark includes a results viewer.

However, as I said last week, the new UI design did not make it into CP1. Over the next few weeks, we’ll be working to give TouchXPRT an exciting new look. The results viewer will also change a lot. The current version captures the date, time, and test results, but the sandbox environment of Windows 8 applications makes getting the system information challenging. We’re working to solve that problem.  We’ll also be improving the results submission to make it more streamlined.

Rest assured that, while the appearance will change, the results will not. The test results you generate with CP1 will be good for the life of the benchmark.

Community previews are only available to community members. If you are not a member, this a great time to join.

After you’ve downloaded CP1, let us know what you think by posting to the forum or e-mailing us at BenchmarkXPRTsupport@principledtechnologies.com.

Eric

Comment on this post in the forums

It’s almost here

Sometime next week, we plan to release a sneak preview of TouchXPRT 2014, the TouchXPRT 2014 Community Preview 1 (CP1).

CP1, as its name makes clear, is not the final TouchXPRT 2014 release. There is still a lot of work to do on the user interface and the new results viewer.  However, it includes a number of improvements over the current TouchXPRT, making it an even more useful tool for measuring Windows 8 and Windows 8.1 device performance. It is also a great way for everyone in the community to see the current state of our thinking and to provide us with feedback. You can run this version of the tool and see what you think!

As we have done with previous community previews, we’re also taking two more steps:

  • We’re not putting any publication restrictions on this preview release. Test at will, and publish your findings.
  • We’re releasing the source code to all community members. If you’re curious about not just what we’re doing but how we’re doing it, you can find out.

We believe these steps make the tool easier to evaluate and more useful to all of us.

Releasing a preview version is a lot of work, because we have to do much of the work of a software release and on less-than-final code, but we believe the value to our community justifies the effort.

Next week, when we release CP1, I’ll go over more details, the known limitations, and how you can get us your feedback—feedback we very much want.

Between now and then, we’ll be readying CP1 for your use.

Eric

Comment on this post in the forums

Check out the other XPRTs:

Forgot your password?