Category: TouchXPRT development process

The benefits of membership

on September 24, 2015

We have a couple of goodies for community members coming tomorrow.

The TouchXPRT 2016 design overview will tell you what we’re planning for the upcoming community preview. Thanks to everyone who’s contributed ideas. Let us know if the design overview omits anything you’d like to see in the benchmark.

The MobileXPRT 2015 source code and the instructions for building MobileXPRT 2015 will be available as well. Community members have access to the source for all the XPRT benchmarks. Making the source available is a pillar of the community model.

Look for the design overview and source code in the members’ area.

If you aren’t yet a member, this is a great time to join!

Eric

One now, one later

By Eric Hale

on July 9, 2015

Windows 10 has been on our mind this week.

Last week, we explained why the Notes test in WebXPRT would not complete when running in Edge on Windows 10. We’ve implemented the fix we discussed and have finished testing the updated versions of WebXPRT 2013 and WebXPRT 2015. We’ll release them by the end of the week. Results from the new versions are comparable with results from the existing versions.

In the current Windows 10 Mobile Beta, WebXPRT 2015 does not scroll correctly in portrait mode. It does scroll correctly in landscape mode, so, as a workaround, one can run it that way on the Windows 10 Mobile Beta.

Speaking of Windows 10 Mobile, we’ve talked before about TouchXPRT 2016 and how its purpose is to compare Windows 10 across different device types. However, Microsoft has said that Windows 10 Mobile won’t be available until after the release of Windows 10 on PCs. More importantly, the APIs and development tools won’t be final until July 29. Once Microsoft releases those tools, we’ll do our builds and tests and release a community preview.

That being said, TouchXPRT 2014 is the tool to use for comparing Windows 8.1 and Windows 10. By the time mobile devices running Windows 10 are available, TouchXPRT 2016 will be available.

Eric

Posted in TouchXPRT, TouchXPRT 2014, TouchXPRT 2016, TouchXPRT development process, WebXPRT, WebXPRT 2015, Windows 10, Windows 8.1 |

Hoping for a perfect 10

By Eric Hale

on June 18, 2015

As many of you know by now, the release date for Windows 10 is July 29. As we’ve said before, we are hard at work getting TouchXPRT ready for Windows 10. We’ve succeeded in building TouchXPRT as a universal app, and it’s now running on Windows 10. We haven’t successfully run it on Windows 10 Phone yet, but we’re working on that.

Unfortunately, I can’t share any performance data. The EULA for the current build of Windows 10 (build 10143 as I’m writing this) forbids publishing benchmark results without prior written approval from Microsoft.

We’ll continue testing and refining the porting of TouchXPRT to Windows 10. Our goal is to release it as a universal app to the community in July.

What are your experiences testing Windows 10? We’d love to hear about them!

Eric

Posted in Performance benchmarking, TouchXPRT, TouchXPRT development process, TouchXPRT release cycle, Windows 10 |

TouchXPRT 2014 is almost here

By Eric Hale

on May 8, 2014

We’re excited to say that TouchXPRT 2014 will launch within the next few days. TouchXPRT 2014 includes a completely new UI, updated component tests, improved disclosure information, improved automation, and the ability to submit results directly from the app.

TouchXPRT 2014 also addresses the number-one request we got about TouchXPRT 2013—to make it more obvious how to run all the tests. In TouchXPRT 2013, users had to choose the Run All button from the hidden Charms menu to run all of the tests and produce an overall score. In TouchXPRT 2014, the Start Test button on the benchmark’s main page makes it obvious how to run all five tests at once.

After the launch, TouchXPRT will be available for download at TouchXPRT.com and through the Windows App Store.

TouchXPRT 2013 will continue to be available for a while, as we understand that labs may have tests in progress. Likewise, the TouchXPRT 2013 results database will continue to be available, but separate from the TouchXPRT 2014 results. You should never compare results for the two versions of TouchXPRT.

For a more in-depth discussion of the new benchmark, please read the Exploring TouchXPRT 2014 white paper.

We’ve been busy with the BatteryXPRT and TouchXPRT launches, but more is on the way. HDXPRT 2014 is next in line!

Eric

Comment on this post in the forums

Posted in HDXPRT 2014, TouchXPRT 2014, TouchXPRT development process, White papers, Windows 8, Windows 8.1 |

TouchXPRT CP1

By Eric Hale

on January 30, 2014

This week we released the TouchXPRT 2014 Community Preview 1 (CP1). As with past community previews, the tests are stable and you may publish your results.

CP1 has a number of improvements over TouchXPRT 2013. We’ve updated the tests and used new and more demanding kinds of data. The Run All button is now prominent on the main screen, and the benchmark includes a results viewer.

However, as I said last week, the new UI design did not make it into CP1. Over the next few weeks, we’ll be working to give TouchXPRT an exciting new look. The results viewer will also change a lot. The current version captures the date, time, and test results, but the sandbox environment of Windows 8 applications makes getting the system information challenging. We’re working to solve that problem. We’ll also be improving the results submission to make it more streamlined.

Rest assured that, while the appearance will change, the results will not. The test results you generate with CP1 will be good for the life of the benchmark.

Community previews are only available to community members. If you are not a member, this a great time to join.

After you’ve downloaded CP1, let us know what you think by posting to the forum or e-mailing us at BenchmarkXPRTsupport@principledtechnologies.com.

Eric

Comment on this post in the forums

Posted in Collaborative benchmark development, Community Preview, TouchXPRT 2014, TouchXPRT development process, Windows 8 |

TouchXPRT in the fast lane

By Bill Catchings

on October 25, 2012

I titled last week’s blog “Putting the TouchXPRT pedal to the metal.” The metaphor still applies. On Monday, we released TouchXPRT 2013 Community Preview 1 (CP1). Members can download it here.

CP1 contains five scenarios based on our research and community feedback. The scenarios are Beautify Photo Album, Prepare Photos for Sharing, Convert Videos for Sharing, Export Podcast to MP3, and Create Slideshow from Photos.

Each scenario gives two types of results. There’s a rate, which allows for simple “bigger is better” comparisons. CP1 also gives the elapsed time for each scenario, which is easier to grasp intuitively. Each approach has its advantages. We’d like to get your feedback on whether you’d like us to pick one of those metrics for the final version of TouchXPRT 2013 or whether it makes more sense to include both. You’ll find a fuller description of the scenarios and the results in the TouchXPRT 2013 Community Preview 1 Design overview.

While you’re looking at CP1, we’re getting the source ready to release. To check out the source, you’ll need a system running Windows 8, with Visual Studio 2012 installed. We hope to release it on Friday. Keep your eye the TouchXPRT forums for more details.

Post your feedback to the TouchXPRT forum, or e-mail it to TouchXPRTSupport@principledtechnologies.com. Do you want more scenarios? Different metrics? A new UI feature? Let us know! Make TouchXPRT the benchmark you want it to be.

As I explained last week, we released CP1 without any restrictions on publishing results. It seems that AnandTech was the first to take advantage of that. Read AnandTech’s Microsoft Surface Review to see TouchXPRT in action.

We are hoping that other folks take advantage of CP1’s capability to act as a cross-platform benchmark on the new class of Windows 8 devices. Come join us in the fast lane!

Bill

Comment on this post in the forums

Posted in Benchmark metrics, Collaborative benchmark development, Touch-based benchmarking, Touch-based devices, TouchXPRT development process, TouchXPRT release cycle, TouchXPRT results |

Category: TouchXPRT development process

The benefits of membership

One now, one later

Hoping for a perfect 10

TouchXPRT 2014 is almost here

TouchXPRT CP1

TouchXPRT in the fast lane

Check out the other XPRTs: