Author Archives: Eric Hale

Refining

on September 3, 2015

You may have noticed that we’ve been making some changes to the BenchmarkXPRT pages. We’ve posted links to recent results on the main BenchmarkXPRT page, added a “What’s hot” box highlighting the most recent postings, made it easier to use the benchmark viewer to navigate across benchmarks, and more. We’ll also be including links to the latest news at the end of the blog each week.

The goal of these changes is to make it easier for you to find the information you want, with particular emphasis on making the most recent events easy to find. This is an ongoing process, and we expect to be making additional incremental changes to the pages in the weeks and months ahead.

If you’re a regular user of the BenchmarkXPRT pages, we’d love to hear from you! Are there things you have trouble finding? Do you have any ideas about how to improve the navigation? Is there anything you think works particularly well and do not want to change? All ideas, compliments, and complaints are welcome.

Eric

Last week in the XPRTs

We released MobileXPRT 2015
We added three new TouchXPRT results
We added three new HDXPRT results

MobileXPRT 2015 is here!

By Eric Hale

on August 28, 2015

Today, we’re releasing MobileXPRT 2015, the latest version of our tool for evaluating the performance of Android devices. The BenchmarkXPRT Development Community has been using a community preview for several weeks, but now anyone can run MobileXPRT and publish their results.

MobileXPRT 2015 is compatible with systems running Android 4.4 and above. It is a 64-bit app, but will work on both 32-bit and 64-bit hardware. The new release includes the same performance workloads as MobileXPRT 2013, but not the UX Tests. If you need the UX tests, MobileXPRT 2013 will continue to be available here.

MobileXPRT 2015 is available at MobileXPRT.com and on the Google Play store. Alternatively, you can download the app using either of the links below:

MobileXPRT 2015 application and test data, 243 MB (includes test data with the app)
MobileXPRT 2015 application only, 18 MB (downloads test data during installation)

After trying out MobileXPRT 2015, please submit your scores here and send any comments to BenchmarkXPRTsupport@principledtechnologies.com. We’re eager to hear and see how you’ll use this tool!

Posted in Android, BenchmarkXPRT development community, MobileXPRT, MobileXPRT 2015, Performance benchmarking, Performance testing on tablets |

Upping our game

By Eric Hale

on August 27, 2015

As we wrote last week, we’re releasing MobileXPRT 2015 to the public tomorrow. Thanks to everyone who helped make the community preview a success!

We’re working on the TouchXPRT 2016 design document and will make it available for the community to review soon.

As you know, we’re always investigating initiatives that could improve our game. We’re continuing to investigate creating experimental tests for future XPRTs. Experimental tests will allow us to maintain broad compatibility for each XPRT tool while providing testers with an opportunity to evaluate cutting-edge technologies.

Another initiative involves looking for new partnerships with people who are not yet part of the community, but could add valuable input to the development process. It’s too soon to say much more about this, but we’re having fruitful conversations and hoping that these partnerships will grow the community even more!

If you have ideas about experimental tests, improving the XPRTs, or expanding the community, please let us know.

Eric

Posted in Android, Collaborative benchmark development, Community Preview, Future of performance evaluation, MobileXPRT, MobileXPRT 2015, TouchXPRT, TouchXPRT 2016, What makes a good benchmark? |

We’ve been thinking

By Eric Hale

on August 20, 2015

Last week, we released the community preview for MobileXPRT 2015, and things are looking great. We anticipate a general release next week, probably on the 28th. Many thanks to the community members who are making this preview a success.

Of course, MobileXPRT isn’t the only thing we’ve been working on. Development of TouchXPRT 2016 is in full swing. As we noted in an earlier blog, Microsoft did not release the Windows 10 SDK until the end of July, but this delay has been a bit of a blessing in disguise. The extra time has allowed us to consider additional ways to improve TouchXPRT. As always, we want to hear the community’s input, so please send any comments or suggestions our way. We’ll add them to our ideas and publish a design document in the next couple of weeks.

Like the XPRT previews, the design document is only available to members of the BenchmarkXPRT Development Community. If you’re wondering what membership entails, this video will show you everything you want to know.

Eric

Posted in Android, BenchmarkXPRT, BenchmarkXPRT development community, MobileXPRT, MobileXPRT 2015, TouchXPRT, TouchXPRT 2016, Windows 10 |

MobileXPRT 2015 Community Preview is here!

By Eric Hale

on August 14, 2015

Today we are releasing the MobileXPRT 2015 Community Preview (CP1). MobileXPRT 2015 is compatible with systems running Android 4.4 and above. It is a 64-bit application, but will work on both 32-bit and 64-bit hardware.

MobileXPRT 2015 includes the same performance workloads as MobileXPRT 2013, but not the UX Tests. Should you need the UX tests, MobileXPRT 2013 will continue to be available.

Because this is a community preview, you have to be a community member to download it. Members may download the preview from the MobileXPRT tab in the Members’ Area. There are two options for downloading:

MobileXPRT 2015 CP1 application and test data, 249 MB
MobileXPRT 2015 CP1 application only, 18 MB (downloads test data the first time it’s run)

After trying out CP1, please send in your comments. Either post them to the forum or mail them to BenchmarkXPRTsupport@principledtechnologies.com. If you send us information that’s relevant to the entire community, we may post an anonymous version of your comments to the forum.

Thanks for your participation in the community!

Posted in Android, BenchmarkXPRT, BenchmarkXPRT development community, Collaborative benchmark development, Community Preview, MobileXPRT, MobileXPRT 2015 |

It’s almost here!

By Eric Hale

on August 13, 2015

This Friday, we will be releasing the community preview of MobileXPRT 2015. BenchmarkXPRT Development Community members will be able to download the installation APK from the MobileXPRT tab in the Members’ Area. We are happy to say that, although we thought that MobileXPRT 2015 would only run on Android 5.0 and above, we have been able to extend its compatibility back to Android 4.4 (KitKat).

As we’ve said, the new MobileXPRT is a 64-bit application. Although it will work on both 32-bit and 64-bit hardware, the code will automatically select 64-bit when available. If you want to compare 32-bit performance to 64-bit on a single device, MobileXPRT 2013 will still be available. It’s not a problem to have both versions of MobileXPRT installed at the same time, and results from the two versions of the benchmark are comparable. On the same note, remember that the UX tests are no longer available in MobileXPRT 2015, but they are available as part of MobileXPRT 2013 if you need them.

As always, the results from the community preview will be comparable to the general release.

We hope you enjoy the new MobileXPRT, and we look forward to seeing your results!

Eric

Posted in BenchmarkXPRT development community, Collaborative benchmark development, Community Preview, MobileXPRT, MobileXPRT 2015 |

Author Archives: Eric Hale

Refining

Last week in the XPRTs

MobileXPRT 2015 is here!

Upping our game

We’ve been thinking

MobileXPRT 2015 Community Preview is here!

It’s almost here!

Check out the other XPRTs: