BenchmarkXPRT Blog banner

Category: Benchmarking

The name game

In Something shiny, we discussed the leading contender in our search for new benchmark ideas, a benchmark tailored especially for the Chrome OS, and we’ve been looking at what workloads would make sense.

As we said, the ability to measure battery life would be useful. That’s not easy in the Chrome environment. We think we may be able to do it, but the Chromebook may have to be in developer mode. Even so, we can leverage what we’ve learned from BatteryXPRT to get a reliable estimate of battery life in less than a working day.

Measuring performance, however, is a must. We’ve been looking at the existing WebXPRT workloads as well as other applications, such as education apps, online games, HD video playback, music playback, and more. We’re also looking for areas where using native client execution makes sense, such as higher-resolution photo editing.

In addition, we’re thinking about what we might call this benchmark. ChromeXPRT would be obvious, but probably wouldn’t pass Google’s naming restrictions.

Do you have ideas for the benchmark’s name? Are there Chrome-based benchmark workloads you’d love to see? Let us know at BenchmarkXPRTsupport@principledtechnologies.com!

Eric

Comment on this post in the forums

Stronger, faster, and definitely better

This week we released HDXPRT 2014 Community Preview 1 (CP1) to BenchmarkXPRT Development Community members. For those community members who’ve been around since the beginning, you’ll notice how much HDXPRT has changed. We’ve trimmed down HDXPRT without reducing the value of the test. While HDXPRT 2012 required multiple installation DVDs, HDXPRT 2014 CP1 is available for download in the member’s area. In addition, it took HDXPRT 2012 at least five hours to complete the recommended three test iterations. HDXPRT 2014 is much faster – the total time required for install and three test iterations is less than two hours!

Like all versions of HDXPRT, CP1 uses real-world media applications such as Adobe® Photoshop® Elements 12, Apple® iTunes®11.1, CyberLink MediaEspresso 6.7, and others to perform common consumer tasks like editing photos, converting videos, and editing music files.

If you’re a community member, give CP1 a try. If you have questions about HDXPRT 2014 or any of the XPRTs, please contact us at BenchmarkXPRTsupport@principledtechnologies.com. If you’d like to be a part of future XPRT development and community previews, now’s a great time to join!

Eric

Comment on this post in the forums

HDXPRT 2014 Community Preview 1 is available!

Today, we are releasing the HDXPRT 2014 Community Preview 1 (CP1) to members of the BenchmarkXPRT Development Community.

Download CP1 here.

CP 1 must be installed from the C:\Program Files (x86) directory. Once you’ve unzipped the compressed folder, detailed installation and testing instructions can be found in the HDXPRT 2014 User Manual, located in the Docs folder. You can also find the User Manual posted here in the Members Area.

Note that the compressed folder is approximately 4.8 GB. If you have any trouble with the download, please contact us.

After trying out CP1, please send in your comments. Either post them to the forum or mail them to BenchmarkXPRTsupport@principledtechnologies.com.

Eric

Comment on this post in the forums

BatteryXPRT 2014 for Android and TouchXPRT 2014 source codes are now available.

As we mentioned in the BatteryXPRT 2014 and TouchXPRT 2014 release announcements, we are making the sources available to community members.

Download the BatteryXPRT 2014 source here.

Download the TouchXPRT 2014 source here.

We’re also posting BatteryXPRT build instructions and TouchXPRT build instructions in the Members Area. If you want more information, please contact BenchmarkXPRTsupport@principledtechnologies.com.

We look forward to your feedback!

Eric

Comment on this post in the forums

Something shiny

As I mentioned in Looking for the next big thing, we’ve received some ideas for benchmarks recently. While there were several good ideas, the one that rose to the top of the list was a benchmark for Chrome-based devices.

For the past year or so, Chromebooks have been the fastest-growing segment of the PC market, so there’s a lot of interest. Given the rising profile of Chromebooks, a Chrome OS benchmark seems like a good fit with the existing XPRTs.

We’ve just started batting around ideas about what a Chrome OS benchmark might look like. Because the browser is the interface, WebXPRT is the natural place to start. However, WebXPRT runs on all platforms. We would like a Chrome benchmark to consider Chrome‑specific technologies like Google Native Client. If possible, it would also be great to get the battery life as well as performance.

Those are a few of our ideas. Do you have ideas about what you would like to see in a Chrome OS benchmark? If so, what would you consider most important for it to include? Let us know at benchmarkxprtsupport@principledtechnologies.com!

And remember, we’re always looking for new ideas. If there’s a benchmark you’d love to see, let us know.

Eric

Comment on this post in the forums

TouchXPRT 2014 arrives Friday!

Friday is the big day for TouchXPRT 2014. It will be available for download at TouchXPRT.com and through the Windows App Store no later than 5:00 PM EDT on Friday May 16.

As we mentioned last week, in addition to the new look and more-demanding component tests, TouchXPRT has a number of new features. One feature we are especially excited about is that users will be able to automate their TouchXPRT tests, something they could not do in TouchXPRT 2013.

You can run TouchXPRT 2014 from a command prompt or using scripting mechanisms such as batch files or PowerShell. The scripting interface allows you to set several parameters, including:

  • Start running the test automatically on launch. You can choose to run all of the scenarios to generate an overall score, or run any single scenario for a component test score.
  • Change the number of iterations the test should run.
  • Change the delay before the test starts running after launch.
  • Change the output filename.

You can read the automation details and find specific commands in the Exploring TouchXPRT 2014 white paper.

Also, we’re in the last steps of preparing the HDXPRT 2014 Community Preview. It’s coming in the next couple of weeks, so stay tuned for more information.

Eric

Comment on this post in the forums

Check out the other XPRTs:

Forgot your password?