BenchmarkXPRT Blog banner

Category: HDXPRT 2012

Should something unexpected happen

Eric Hale
By Eric Hale
on August 3, 2012

HDXPRT 2012 is out, and I hope you’ve had the opportunity to start testing with it.

While we have worked hard to make HDXPRT as solid as possible, it’s possible that you may encounter a problem at some point. If that happens, we want to hear about it. Here a few things you can do that will help us solve your problem as quickly as possible.

When HDXPRT fails, it typically creates a folder on the desktop. This folder contains error information and information about the test system. The folder is named “HDXPRT Error Report” suffixed with date and time. For example, HDXPRT Error Report_04-13-12_11-24-00. Zip that directory and send it, along with a brief description of the problem, to HDXPRTsupport@principledtechnologies.com.

Please also include any information you think would be helpful. For example, if you are testing with an OEM version of the operating system, we may be unable to duplicate your problem using a default install of the same operating system. Someone will get back to you within one business day.

To make information about any bugs and their solutions available to the community, we will post it on the forum. If you would prefer not to be acknowledged on the forum, just let us know and we will preserve your anonymity.

Thanks again for your interest.

Eric

Comment on this post in the forums

Posted in HDXPRT 2012 |

HDXPRT 2012 has left the building! Now what?

Bill Catchings
By Bill Catchings
on July 27, 2012

HDXPRT 2012 is finished! We are shipping out the HDXPRT 2012 DVDs to the Development Community membership. If you don’t get yours next week, please let us know. If you would like a copy of HDXPRT 2012, please join the community and we will gladly send you one.

We are also putting out a press release, preparing white papers, and doing the myriad things involved in shipping a product. The benchmark itself, however, is done.

Now that we have had a couple minutes to celebrate that moment, it is time to ask, “What next?” The first and most obvious thing will be to get the RTM of Windows 8 and see what we need to fix to make HDXPRT 2012 work with it. We hope we won’t need to change much–maybe we’ll get lucky and everything will work fine. Regardless, we’ll let you know what is necessary to make HDXPRT 2012 work on Windows 8 or will create an updated version that works on Windows 8.

We will also begin the next cycle for HDXPRT 2013. Now, however, is the best time for you to let us know what you would like to see. Are there particular tests you would like to see? We can add inspection tests to HDXPRT even before the next full version. By an inspection test, I mean a test that may not be relevant for all users or environments and is not part of the overall score. The test might also be an experimental one that we want to try out for possible inclusion in the overall score in the future.

But, for the moment, we plan to enjoy our weekend. We hope you have a great weekend as well!

Bill

Comment on this post in the forums

Posted in HDXPRT 2012, HDXPRT 2013, Let us know your thoughts, Windows 8 |

As we get close to the release

Eric Hale
By Eric Hale
on July 20, 2012

As we get close to the release of HDXPRT 2012, I wanted to let you know how it compares with the original design specification. You’ll find the complete list of differences below.

In any software project, there are differences between the original design and the final product. Generally, things have stayed pretty close with HDXPRT 2012. A number of these changes were discussed on the HDXPRT blog. We’ve noted in parentheses the title and date of the relevant blog entry.

We’re looking forward to the release of HDXPRT2012. We can’t wait to hear what you do with it!

Eric

  • HDXPRT does not support 32-bit operating systems. (“Bye, bye 32 bits?” March 2, 2011)
  • Because of difficulties with scripting, Picassa is not part of HDXPRT 2012. (“Change is inevitable,” April 27, 2012)
  • Audacity 2.0 with Windows 7 debuted after we released the design document, so we are using that version rather than Audacity 1.3.14beta in HDXPRT 2012. (“Change is inevitable,” April 27, 2012)
  • We removed the video playback tests from HDXPRT 2012. (“More HDXPRT 2012 changes,” May 11, 2012) Consequently, Adobe Flash Player 11, which was only used in the playback tests, is not part of HDXPRT 2012.
  • Simplified Chinese is not supported.
  • The specs for the calibration system are below. The design spec had recommended changing to Intel Pentium G860.
    • Processor: Intel E6800, 3.3 GHz
    • Graphics:  Intel G45 Express Chipset
    • Memory: 4 GB
    • Hard disk: 1 TB HDD
    • OS: Windows 7 Ultimate Service Pack 1
  • During testing, we were able to reduce the minimum requirements from those in the Design Document. The current minimum requirements are as follows:
  • Processor: Intel dual-core 2.0GHz processor or equivalent
  • Memory: 2 GB
  • Free disk space: 40 GB
  • Video display settings: 1,024 x 768, 24-bit color
  • DVD ROM to install HDXPRT
  • Microsoft Windows 7, 64-bit (Language: US English)

Comment on this post in the forums

Posted in HDXPRT, HDXPRT 2012, HDXPRT 2012 beta, HDXPRT Development Community benefits |

History in the making

Bill Catchings
By Bill Catchings
on July 13, 2012

We are quickly approaching the debut of HDXPRT 2012. It will be the second version of HDXPRT developed under the benchmark development community paradigm. This milestone provides a nice opportunity to look back at what has happened over the nearly two years since we started creating community-based benchmarks.

The most obvious accomplishment is the development of HDXPRT 2011 and HDXPRT 2012. HDXPRT 2011 has been used around the world for evaluating the performance of computers using applications doing activities that consumers do to create and consume content. We are hopeful that HDXPRT 2012 will be even more widely used.

We also announced earlier this year a new benchmark, TouchXPRT. This benchmark will provide a way to evaluate the performance of the emerging touch-based devices, including tablets. TouchXPRT will debut later this year, initially on Windows 8 Metro.

We have been working hard to get the word out about the benchmarks. We’ve been writing this weekly blog, conducting Webinars, and generally talking with folks in the computer industry. We’ve visited with members of the community around the world at trade shows like CES in Las Vegas and Computex in Taipei. We also spent time with members of the press and computer hardware and software developers. Over the coming months, we are planning to revamp the Web site, add video content, and generally find ways to better engage with and extend the development community.

Less obvious, but equally important to me, has been the development of the development community itself. Developing benchmarks has not been done this way before. We are doing what we can to make the process open to the community, including releasing the benchmark source code. We are optimistic that this method will grow and be a real asset for the industry.

As we look at the growing family of benchmarks under the benchmark XPRT umbrella, the question is always what is next? How can we improve the products and the community? What performance areas do we need to look at in the future? Battery life? Macs? Phones?

Thanks so much for joining us on this journey. The members of this community are what make it work. We look forward to continuing the journey with you!

Bill

Comment on this post in the forums

Posted in Application-based benchmarks, Collaborative benchmark development, HDXPRT, HDXPRT 2012, History of benchmarking, TouchXPRT |

Counting down

Eric Hale
By Eric Hale
on July 6, 2012

We’ve been hard at work since the end of the beta period, driving toward the release of HDXPRT 2012. Things are looking good. The RTM is coming soon, so we thought we’d share the next few milestones with you.

  • RTM candidate:  7/13/12. At this point, we stop development. There are no feature changes after this point.
  • HDXPRT 2012 launch: 7/27/12. Having tested the RTM and manufactured the DVDs, we mail the benchmark to the community members. This is when the press release goes out. It’s also when we publish the HDXPRT 2012 white paper. Unlike the design document, this paper will explain HDXPRT 2012 to the general public.
  • Webinar: 8/3/28 – We talk about HDXPRT 2012 and take your questions.
  • First scaling paper: 8/31/12. As with HDXPRT 2011, we will be publishing a set of scaling studies. The first will test several modern desktop processors, looking at factors such as varying the amount of RAM, comparing HDDs to SSDs, and comparing internal graphics to a couple of popular graphics cards.
  • Second scaling paper: 9/28/12. In this paper, we expand on the testing we did in the first scaling paper.

 

We will release an update of HDXPRT 2012 that supports Windows 8 and includes bug fixes within a month of Windows 8 launch.

We’re very excited about the release of HDXPRT 2012, and look forward to seeing what you do with it!

Eric

Comment on this post in the forums

Posted in Application-based benchmarks, Collaborative benchmark development, HDXPRT, HDXPRT 2012, HDXPRT 2012 beta, HDXPRT development process, HDXPRT release cycle |

Software updating when everything uses software

Bill Catchings
By Bill Catchings
on June 8, 2012

Software updating when everything uses software

The latest beta of Windows 8 Release Preview is out and we are scrambling to see what works with it and what doesn’t. After many years in the software industry, I’ve come to expect that. Now, however, pretty much everything goes through many cycles of software updates. The results can be annoying. Or worse.

Two weeks ago, I took my Nissan LEAF in for its 6-month check-up. While there, the dealer did a software update. I’ve had no real problems with it and, in general, I love the car . However, after the update, the LCD display on my console is different. It now displays the time in the upper right. Unfortunately, that time is different from the one that displays beneath the windshield. I guess I need to read some manuals. Annoying.

This week, the Garmin Edge 500 bicycle computer I use had an available update and I updated it. Everything seemed to go fine on my 36-mile bike ride a couple days later. When I went to upload the ride to the Garmin Connect Web site, it told me I need to update my Edge 500 (to the same version) and claimed there were no new rides on the device. After some frustration, I managed to get it all working without losing the data from my ride. Very annoying.

It seems like I’m constantly updating my iPhone, my Xbox 360, my TV, my iPad, Windows on my PC, Mac OS on my Mac, and, of course, applications everywhere. Usually, the updates work fine. But, when the glitches happen, I am tempted to never update anything again. Very annoying, indeed.

In the meantime, it’s back to working on updating HDXPRT 2012!

Bill

Comment on this post in the forums

Posted in HDXPRT 2012, HDXPRT development process |

Check out the other XPRTs:

Forgot your password?
© Principled Technologies, Inc. 2024   |   Privacy policy

Cookie Notice: Our website uses cookies to deliver a smooth experience by storing logins and saving user information. By continuing to use our site, you agree with our usage of cookies as our privacy policy outlines.

x