BenchmarkXPRT Blog banner

TouchXPRT’s future

If you’ve been following the blog, you know that we’ve been reviewing each part of the XPRT portfolio. If you missed our discussions of HDXPRT, BatteryXPRT, WebXPRT, and CrXPRT, we encourage you to check them out and send us any thoughts you may have. This week, we continue that series by discussing the state of TouchXPRT and what we see down the road for it in 2017.

We released TouchXPRT 2016, an app for evaluating the performance of Windows 10 and Windows 10 Mobile devices, last February. We built the app by porting TouchXPRT 2014 performance workloads to the new Universal Windows App format, which allows a single app package to run on PCs, phones, tablets, and even consoles.

TouchXPRT 2016 installation is quick and easy, and the test completes in under 15 minutes on most devices. The app runs tests based on five everyday tasks (Beautify Photos, Blend Photos, Convert Videos for Sharing, Create Music Podcast, and Create Slideshow from Photos). It measures how long your device takes to complete each task, produces results for each scenario, and gives you an overall score.

As we think about the path forward for TouchXPRT, we’re aware that many expect 2017 to be a year of significant change in the Windows world, with two updates scheduled for release. Microsoft is slated to release the Windows 10 Creators Update (Build 1704) in April, and a subsequent version of Windows codenamed Redstone 3 may arrive this fall. Many tech observers believe that the Creators Update will introduce new creativity and gaming features, along with a UI upgrade named Project NEON. Major foundational shifts in the OS’s structure are more likely to appear with Redstone 3. At this point, quite a lot is still up in the air, but we’ll be following developments closely.

As we learn more about upcoming changes, we’ll have the opportunity to reevaluate TouchXPRT workloads and determine the best way to incorporate new technologies. Virtual reality, 3D, and 4K are especially exciting, but it’s too soon to know how we might incorporate them in a future version of TouchXPRT.

Because TouchXPRT 2016 continues to run well on a wide range of Windows 10 devices, we think it’s best to keep supporting the current version until we get a better idea of what’s in store for Windows.

If you have any thoughts on the future of Windows performance testing, please let us know!

Bill

BatteryXPRT 2014 gets an update

After Android 7 (Nougat) was released on select devices this past fall, we discovered an issue with BatteryXPRT on devices running Android 7 and above. The battery life tests were completing accurately and reliably, but the test was not producing a performance score.

The problem was a result of significant changes in the Android development environment. Android 7 restricted the flags used for different target architectures when linking native code components, and that caused issues while executing part of the Create Slideshow workload. We resolved the issue by changing the linked flags. Also, we migrated the BatteryXPRT code from the Eclipse and Android SDK development environments to the up-to-date Android Studio environment. This allowed us to rebuild the app in a way that maintains compatibility with the most recent versions of Android.

Today, we’re releasing a new build of BatteryXPRT 2014 (v104) at BatteryXPRT.com and the Google Play store. Scores from this build are comparable with previous BatteryXPRT scores, and if you’re testing with a version of BatteryXPRT that you downloaded from the Google Play store, you should receive the new build via an app update.

Click here to download the new BatteryXPRT installer (330 MB) directly from our site.

For users who have limited bandwidth or trouble accessing the Google Play store, downloading the APK files (26.7 MB total) may make installation easier.

Download the updated BatteryXPRT APK (2.8 MB) directly from our site.

Download the updated BatteryXPRT Tests APK (23.9 MB) directly from our site.

If you have any questions about the update or any other XPRT-related topic, feel free to contact us at BenchmarkXPRTSupport@principledtechnologies.com.

Justin

CrXPRT’s future

This week, we’re continuing our review of the XPRT portfolio by discussing the future of CrXPRT. CrXPRT, designed for use with Chrome OS, is a tool for evaluating the performance and battery life of Chromebooks as they handle everyday tasks. The app’s performance test, which measures Chromebook speed, produces an overall score and individual scores for each workload. The battery life test produces an estimated battery life and a separate performance score. CrXPRT is easy to install and use, and like BatteryXPRT, it evaluates battery life in half a workday.

We developed CrXPRT in response to the growing popularity of Chromebooks, especially in the education sector. The number of OEMs manufacturing Chromebooks has grown dramatically, along with the range of Chromebook price points and form factors. That growth shows no signs of slowing down, so CrXPRT is more relevant than ever as a tool for helping consumers make informed buying decisions.

As Chromebook market share continues to grow, however, it’s clear that significant changes to the Chrome OS environment are on the way. One big change is Google’s decision to bring Android apps, and the Google Play store itself, to Chrome OS. Another change is the plan to “begin the evolution away” from the Chrome apps platform and phase out Chrome app support on other platforms within the next two years.

There are also reports of a hybrid Android-Chrome OS operating system. Codenamed “Andromeda,” it would unite the Android and Chrome OS environments in a manner similar to the way Microsoft Continuum allows Windows 10 to run on a wide variety of device types. Details on Andromeda are few and far between, but it would obviously be a game changer.

The Google Play store rollout to select Chromebooks is already well underway. As for the other changes, it remains to be seen exactly when and how they will be implemented. The Chromium team did state that all types of Chrome apps will remain supported and maintained on Chrome OS for the foreseeable future.

For us, it’s important to maintain the ability to measure both performance and battery life on Chromebooks. The current version of CrXPRT does the job well, so we don’t see a need for a new version until the situation becomes more clear. In the meantime, we’ll be keeping an eye on Chrome-related news.

As always, we’re interested in your feedback. If you have any thoughts on CrXPRT 2015 or the future of Chromebook evaluation, let us know!

Justin

Reflecting on 2016

The beginning of a new year is a good time to look back on the previous 12 months and take stock of everything that happened. Here’s a quick recap of a very busy year:

In 2016, the XPRTs travelled quite a bit. Eric went to CES in Las Vegas, Mark attended MWC in Barcelona, and Bill flew out to IDF16 in Shenzhen.

We also sent a team to Seattle for the first XPRT Women Code-A-Thon, an event we’re very proud to have sponsored and co-hosted along with ChickTech, a nonprofit organization dedicated to increasing the number of women in tech-related fields. The Code-a-thon also served as inspiration for an eight-part video series entitled Women Coding for Change. The series explains the motivation behind the Code-a-thon and profiles several of the participants. If you haven’t watched the videos, check them out. They’re well worth the time.

Speaking of videos, we also published one about Nebula Wolf, the mini-game workload produced through our first collaboration with the North Carolina State Senior Design Center. That experience was promising enough for us to partner with another student team this past fall, which resulted in a virtual reality app that we hope to share with the community in the near future.

Of course, we also continued work on our suite of benchmark tools and related resources. We released TouchXPRT 2016 to the public, published the Exploring TouchXPRT 2016 white paper, and released the TouchXPRT 2016 source code to community members.

In 2016, we unveiled the XPRT Weekly Tech Spotlight, a new way for device vendors and manufacturers to share verified test results with buyers around the world. We put 46 devices in the spotlight throughout the year and published Back-to-School, Black Friday, and Holiday device showcases.

In the last quarter of 2016, we celebrated our most widely-used benchmark, WebXPRT, passing the 100,000-run milestone. WebXPRT is still going strong and is as useful and relevant as ever!

Finally, we ended the year with the exciting news that we’re moving forward with efforts to develop a machine-learning performance evaluation tool. We look forward to engaging with the community in the coming year as we tackle this challenge!

As always, we’re grateful for everyone who’s helped to make the BenchmarkXPRT Development Community a strong, vibrant, and relevant resource for people all around the world. Here’s to a great 2017!

Justin

CES 2017

I’ve attended many tech shows over the years, but this year’s CES has more energy than any I’ve attended in a long time. Part of the energy is the breadth of products. There are amazingly slim TVs that make my TV at home, which I thought was slim, look fat. And, there are beautiful 8K TVs that make my new 4K one feel old.

I’m seeing all manner of smartphones. I’m seeing mobile remote presence devices such as the one from Beam, and after seeing the latest Fenix 5 from Garmin, I think I’ve found my next smartwatch.

Photo Jan 05, 2 05 53 PM

There are many differing devices and approaches to VR and AR. There are drones everywhere. And, lots of massage chairs.

Photo Jan 05, 1 13 17 PM

There are also plenty of products, let’s call them longshots, that contribute to the Wild West feel of the show. Maybe you’d like the Hydreon FakeTV, a small device to make it seem like a TV is on in your house to keep away burglars? Or Dr. Fuji’s Body Shaper, a vibrating platform to “accelerate your workout”?

Another part of the dynamic feeling is the breadth of vendors. Almost all the big tech vendors are here, except for Apple, of course. The excitement for me, however, is the small vendors displaying things that may well never see the light of day, but give glimpses of the future. For example, while I doubt most of the drone vendors at CES will be around in a few years, I think the trend toward small, inexpensive selfie drones will be.

The main reason for the energy at this year’s CES could be the convergence of multiple big industries. The most obvious example of this phenomenon is the large auto presence. Cars have been at CES before—the first time I drove my current car, a BMW i3, was at CES 2014—but this time around they seem to really want to make a statement. Faraday Future is making a splash by trying to be the next Tesla with its FF91.

Photo Jan 05, 3 08 30 PM

Multiple vendors, including VW, Nissan, Toyota, and Mercedes, have concept cars on display—most of them are electric and all of them are heavy on technology. The biggest tech they’re touting is autonomous driving. The auto companies are showing their products while companies like NVIDIA, Intel, and Magic Eye are displaying the tech they have as well.

Regardless of the source of the energy at this CES, I see many opportunities for the existing XPRTs to continue to be important resources. I also see how important emerging technologies like machine learning and VR/AR are going to be and how the XPRTs can be of help there as well.

Exciting times!

Bill

Principled Technologies and the BenchmarkXPRT Development Community announce new effort to evaluate machine learning performance

Durham, NC – Principled Technologies (PT) and the BenchmarkXPRT Development Community, which PT administers, are pleased to announce an initiative to develop a new tool for evaluating systems’ machine learning performance.

Machine learning is a disruptive technology that has the potential to influence a broad range of industries. While there are many available consumer and commercial applications that utilize machine learning for computer vision, natural language processing, and data analytics, there is currently no comprehensive machine learning or deep learning benchmark that includes home, automotive, industrial, and retail use cases.

“These are still the early days of the technology. A fragmented software and hardware landscape and lack of standardization make it complex and challenging to evaluate performance in machine learning,” said Bill Catchings, Co-Founder and Co-Owner of PT. “We’ve decided to take on that challenge, and we invite all interested parties to participate in the creation, evaluation, and testing of this new tool.”

The new tool will join the rest of the industry-standard benchmarks from the BenchmarkXPRT Development Community: WebXPRT, MobileXPRT, TouchXPRT, CrXPRT, BatteryXPRT, and HDXPRT.

To learn more about and join the BenchmarkXPRT Development Community, go to www.BenchmarkXPRT.com.

About Principled Technologies, Inc.

Principled Technologies, Inc. is a leading provider of technology marketing and learning & development services. It administers the BenchmarkXPRT Development Community.

Principled Technologies, Inc. is located in Durham, North Carolina, USA. For more information, please visit www.PrincipledTechnologies.com.

Company Contact

Bill Catchings
Principled Technologies, Inc.
1007 Slater Road, Suite #300
Durham, NC 27703
bcatchings@principledtechnologies.com

Check out the other XPRTs:

Forgot your password?