BenchmarkXPRT Blog banner

Category: Windows 10

Looking ahead

It’s only been a couple of weeks since we announced a cross-platform XPRT. It’s still early days, but we’ve already started getting ideas from vendors and media—from both people within the community and those who have not yet joined. We’re incorporating these ideas into our investigations, and plan to be sending a design document for the community to critique in a few weeks.

However, we are always looking ahead and Bill’s trip to IDF16 got us thinking about future benchmarks. Virtual reality is obviously going to be big. Bill said that he thinks he saw more things using the Oculus Rift than there are Oculus Rifts in the world! The Internet of Things has been ramping up for a while now, and shows no sign of slowing down. Computer vision is another emerging area, one with many possible applications. There are a lot of exciting possibilities!

As always, we want to know what you think. What upcoming technologies are you excited about? What would like to see in these benchmarks? Please let us know!

Eric

One benchmark to test them all

It’s no secret that the XPRTs are a great way to get device results you can count on. Tens of thousands of people over six continents have used the XPRTs to help them make smart buying choices, and over a thousand media outlets have quoted XPRT results when reporting on the hottest tech. WebXPRT has always been the “go to” XPRT, because you can use it to test the widest range of devices. WebXPRT runs in the browser, however, so browser performance influences the results.

For a long time, our members and others have asked for a tool that would let you compare application performance on any type of device. People want a cross-platform XPRT that runs on devices the same way apps do.

We’re excited to announce that we’re going to create just that tool! Specifically, we’re going to create a version of MobileXPRT that runs on Android, iOS, and Windows.

This will not be easy. At one point in my career, I was in charge of a group that ported applications between platforms, and I learned from hands-on experience that doing that job well is very difficult. It’s not enough to simply make the application run; it also has to run efficiently on each type of system. MobileXPRT works at the application level, so we’ll have to deal with the many differences in the operating system architectures and APIs. We’ll have to make sure the code runs well on all three target OSes.

We’re willing to do all this work because the need for such a tool has never been greater. More and more devices hit the market all the time, and choosing the ones you want is tougher than ever. iPhone or Android phone? Windows tablet, Android tablet, or iPad?

The coming MobileXPRT will let buyers around the world answer those questions.

We’re not going to do this work in isolation. We will reach out to the OS vendors, because we want their input, comments, and help. We’ll make the source available to them, and we welcome their critiques and guidance in creating the best possible version for each OS.

Of course, we very much want your input, too. Do you have any thoughts about what you’d like to see in a cross-platform XPRT? If so, let us know!

Bill

Last week in the XPRTs
We published the XPRT Weekly Tech Spotlight on the Apple iPhone SE.
We added one new MobileXPRT ’15 result.
We added seven new WebXPRT ’15 results.

TouchXPRT 2016 is here!

Today, we released TouchXPRT 2016, the latest version of our tool for evaluating the performance of Windows devices. The BenchmarkXPRT Development Community has been using a community preview for several weeks, but now anyone can run TouchXPRT 2016 and publish their results.

TouchXPRT 2016 is compatible with systems running Windows 10 and Windows 10 Mobile. The new release includes the same performance workloads as TouchXPRT 2014, but with updated content and in the form of a Universal Windows app.

TouchXPRT 2016 is available at TouchXPRT.com and in the Windows App store.

After trying TouchXPRT 2016, please submit your scores and send any comments to BenchmarkXPRTsupport@principledtechnologies.com. We’re eager to find out how you’ll use this tool!

TouchXPRT 2016 Community Preview 3 is available

Today we are releasing TouchXPRT 2016 Community Preview 3 (CP 3). As we discussed in the blog, CP 3 resolves an issue reported on some systems, where the Create Slideshow test would take longer than expected to complete due to the output video not rendering correctly.

As with all community previews, TouchXPRT 2016 CP 3 is available only to community members. Members may download the preview from the TouchXPRT tab in the Members’ Area.

For more details about TouchXPRT 2016, please consult the release notes for further details (login required).

After you try out CP 3, please send us your comments. Either post them to the forum or mail them to BenchmarkXPRTsupport@principledtechnologies.com. If you send us information that’s relevant to the entire community, we may post an anonymous version of your comments to the forum.

Thanks for your participation!

Detective work

A few weeks ago, we described an issue with TouchXPRT’s Create Slideshow test. On some systems, this test would take longer than expected to complete due to the output video not rendering correctly. Since then, we released TouchXPRT 2016 CP2, which includes a check that verifies the output and reports an error if there’s a problem.

It took a lot of detective work, but I’m happy to say that we’ve been able to resolve this issue. We had to make a couple of changes. First, we changed the pixel format in which the photo content is read from GUID_WICPixelFormat32bppPBGRA to GUID_WICPixelFormat32bppBGR. Second, we changed the media format of the input into the video converter from MFVideoFormat_ARGB32 to MFVideoFormat_RGB32.

After making these changes, the Create Slideshow test ran in the expected amount of time, and rendered the output video correctly.

In our testing so far, results have not changed noticeably. However, we’re continuing to test. We want to be sure that the updated build is stable and that results are comparable to earlier TouchXPRT CPs. We’ll then release it to the community.

Here’s looking forward to the release of TouchXPRT 2016 to the world at large!

Looking forward

If you’re in the US, I hope you had a great Thanksgiving, and that you survived Black Friday!

On Monday, we released the second community preview for TouchXPRT 2016 (CP2). It detects the issue we described last week, by checking whether the Create Slideshow scenario completes correctly, and alerts you if it does not. We’re continuing to investigate this issue and will let you know as soon as we have more information. Results from CP2 are comparable to results from CP1. Please let us know if you have any questions or problems.

In other news, I’ll be at CES 2016 in Las Vegas in January. I can’t wait! We’re going to have some big news after the first of the year. I can’t say anything about it yet, but I’m looking forward to discussing it with folks there. If you’re planning to be at CES, send me a message, and let’s meet!

Eric

Check out the other XPRTs:

Forgot your password?