Tag Archives: HDXPRT

Following up on XPRT compatibility with Windows 11

on September 16, 2021

Last week, we discussed the upcoming Windows 11 GA launch on October 5, and our hope is that the transition period from Windows 10 to Windows 11 will go smoothly for the three XPRTs that run on Windows 10, HDXPRT 4, TouchXPRT 2016, and AIXPRT. We’re happy to report that so far, we’ve been able to install HDXPRT 4 and TouchXPRT 2016 on the latest stable preview of Windows 11 without any problems. For TouchXPRT 2016, we successfully installed the benchmark using both available methods—directly from the Microsoft Store and through the manual sideload process—and ran it without issues.

We’re still testing Windows 11 compatibility with the AIXPRT OpenVINO, TensorFlow, and TensorRT test packages, and will share our findings here in the blog as soon as possible. Also, because Microsoft might still publish through the stable preview channel Windows 11 changes that interfere with the HDXPRT 4 or TouchXPRT 2016 installation or testing processes, we’ll continue to verify each benchmark’s Windows 11 compatibility up through and beyond launch day.

If you’re conducting your own HDXPRT 4, TouchXPRT 2016, or AIXPRT testing on the Windows 11 beta, you could encounter issues with newly published updates before we do due to the timing of our update cycles. You could also run into problems that are specific to your test gear. In either case, please don’t assume that we already know about the problem. Let us know!

Justin

Posted in Adobe, AIXPRT, Application-based benchmarks, benchmark, Benchmarking, HDXPRT, HDXPRT 4, Performance benchmarking, TouchXPRT, TouchXPRT 2016, Windows 11, Windows Update | Also tagged AIXPRT, Microsoft, Photoshop, Photoshop Elements, TouchXPRT, Windows 11

Testing XPRT compatibility with Windows 11

By Justin Greene

on September 9, 2021

Last week, Microsoft announced that the Windows 11 GA build will officially launch Tuesday October 5, earlier than the initial late 2021 estimate. The update will start rolling out with select new laptops and existing Windows 10 PCs that satisfy specific system requirements, and only some Windows 10 PCs will be eligible for the update right away. Through a phased Windows Update process, additional Windows 10 PCs will be able to access the update throughout the first half of 2022.

Between the phased Windows 11 rollout and the pledge Microsoft has made to continue Windows 10 support through October 2025, it will likely be a while before the majority of Windows users transition to the new version. We hope the transition period will go smoothly for the XPRTs. However, because we designed three of our benchmarks to run on Windows 10 (HDXPRT 4, TouchXPRT 2016, and AIXPRT), we might encounter compatibility issues with Windows 11.

Over the coming weeks, we’ll be testing HDXPRT 4, TouchXPRT 2016, and AIXPRT on beta versions of Windows 11, and we’ll test again after the GA launch. In addition to obvious compatibility issues and test failures, we’ll note any changes we need to make to our documentation to account for differences in the Windows 11 installation or test processes.

We hope that testers will be able to successfully use all three benchmarks on both OS versions throughout the transition process. If problems arise, we will keep our blog readers informed while exploring solutions. As always, we’re also open to feedback from the community, so if you are participating in the Windows Insider Program and have encountered Windows 11 beta compatibility issues with any of the Windows-focused XPRTs, please let us know!

Justin

Posted in AIXPRT, benchmark, Benchmarking, BenchmarkXPRT, HDXPRT 4, Performance benchmarking, TouchXPRT, Windows, Windows 10, Windows 11 | Also tagged AIXPRT, HDXPRT 4, TouchXPRT, TouchXPRT 2016, Windows, Windows 10, Windows 11

Thinking ahead to the next HDXPRT

By Justin Greene

on November 12, 2020

We’re currently formulating our 2021 development roadmap for the XPRTs. In addition to planning CloudXPRT and WebXPRT updates, we’re discussing the possibility of releasing HDXPRT 5 in 2021. It’s hard for me to believe, but it’s been about two and a half years since we started work on HDXPRT 4, and February 2021 will mark two years since the first HDXPRT 4 release. Windows PCs are more powerful than ever, so it’s a good time to talk about how we can enhance the benchmark’s ability to measure how well the latest systems handle real-world media technologies and applications.

When we plan a new version of an XPRT benchmark, one of our first steps is updating the benchmark’s workloads so that they will remain relevant in years to come. We almost always update application content, such as photos and videos, to contemporary file resolutions and sizes. For example, we added both higher-resolution photos and a 4K video conversion task in HDXPRT 4. Are there specific types of media files that you think would be especially relevant to high-performance media tasks over the next few years?

Next, we will assess the suitability of the real-world trial applications that the editing photos, editing music, and converting videos test scenarios use. Currently, these are Adobe Photoshop Elements, Audacity, CyberLink MediaEspresso, and HandBrake. Can you think of other applications that belong in a high-performance media processing benchmark?

In HDXPRT 4, we gave testers the option to target a system’s discrete graphics card during the video conversion workload. Has this proven useful in your testing? Do you have suggestions for new graphics-oriented workloads?

We’ll also strive to make the UI more intuitive, to simplify installation, and to reduce the size of the installation package. What elements of the current UI do you find especially useful or think we could improve?

We welcome your answers to these questions and any additional suggestions or comments on HDXPRT 5. Send them our way!

Justin

Posted in Adobe, Application-based benchmarks, benchmark, BenchmarkXPRT, CloudXPRT, Collaborative benchmark development, Future of performance evaluation, HDXPRT, HDXPRT 4, HDXPRT development process, HDXPRT metrics, HDXPRT release cycle, Performance benchmarking, WebXPRT, What makes a good benchmark? | Also tagged Adobe, Audacity, benchmark, BenchmarkXPRT, CloudXPRT, CyberLink, Handbrake, WebXPRT

The ongoing evolution of the BenchmarkXPRT Development Community

By Justin Greene

on August 6, 2020

This November will mark the tenth anniversary of the BenchmarkXPRT Development Community, which we originally called the HDXPRT Development Community. Since the early days of HDXPRT, our community has grown to include about 275 members from over 85 companies and organizations, and we’ve added seven benchmarks to the XPRT family. We initially mailed HDXPRT DVDs to testers interested in a new way to evaluate PC performance, and now thousands of users around the world download our benchmarks and rely on them to help measure the performance of everything from tablets to laptops to high-end datacenter hardware.

As the XPRTs continue to grow and evolve, we’ve worked to make sure that the resources that we offer—and the ways we offer them—continue to meet the needs of XPRT testers and community members. As we expand in the AI and datacenter spaces with AIXPRT and CloudXPRT, our user group is becoming larger and more diverse than ever. We have already made some changes to better serve this expanding group, and will be making additional changes over the months ahead.

The first set of changes relate to our community membership model. Originally, membership in the BenchmarkXPRT Development Community required a $20 fee and provided access to preview versions of new benchmarks, the ability to submit ideas for future benchmarks, and regular updates through our monthly newsletter and community announcements. To remove the financial obstacle to joining, we introduced a fee waiver process a few years ago.

Also, we know that some OEM employees and members of the tech press are interested in the XPRTs, but are unable to join the community for one reason or another. With these people in mind, we recently experimented with making the CloudXPRT Preview publicly available. Releasing preview builds to all who are interested makes it more likely that users will incorporate the XPRTs into their test suites, and we have decided to adopt this practice for other benchmarks going forward.

In the coming months, we’ll be updating parts of our website to increase access to XPRT content. For example, certain content such as source code for most of the XPRTs is currently available only to members. We plan to remove the login requirement for access to this material.

Please keep in mind that membership in the BenchmarkXPRT Development Community continues to offer exclusive opportunities. Members can join groups such as the CloudXPRT Results Review Group and offer direct input into the design of future benchmarks. Members also receive our monthly newsletters.

If you have any questions about the XPRTs or community membership, please feel free to ask!

Justin

Posted in AI, AIXPRT, benchmark, BenchmarkXPRT, BenchmarkXPRT development community, Cloud, CloudXPRT, Community Preview, Datacenter, HDXPRT, Performance benchmarking, Source code | Also tagged AI, AIXPRT, benchmark, BenchmarkXPRT, cloud, CloudXPRT, datacenter

Adapting to a changing tech landscape

By Justin Greene

on April 23, 2020

The BenchmarkXPRT Development Community started almost 10 years ago with the development of the High Definition Experience & Performance Ratings Test, also known as HDXPRT. Back then, we distributed the benchmark to interested parties by mailing out physical DVDs. We’ve come a long way since then, as testers now freely and easily access six XPRT benchmarks from our site and major app stores.

Developers, hardware manufacturers, and tech journalists—the core group of XPRT testers—work within a constantly changing tech landscape. Because of our commitment to providing those testers with what they need, the XPRTs grew as we developed additional benchmarks to expand the reach of our tools from PCs to servers and all types of notebooks, Chromebooks, and mobile devices.

As today’s tech landscape continues to evolve at a rapid pace, our desire to play an active role in emerging markets continues to drive us to expand our testing capabilities into areas like machine learning (AIXPRT) and cloud-first applications (CloudXPRT). While these new technologies carry the potential to increase efficiency, improve quality, and boost the bottom line for companies around the world, it’s often difficult to decide where and how to invest in new hardware or services. The ever-present need for relevant and reliable data is the reason many organizations use the XPRTs to help make confident choices about their company’s future tech.

We just released a new video that helps to explain what the XPRTs provide and how they can play an important role in a company’s tech purchasing decisions. We hope you’ll check it out!

We’re excited about the continued growth of the XPRTs, and we’re eager to meet the challenges of adapting to the changing tech landscape. If you have any questions about the XPRTs or suggestions for future benchmarks, please let us know!

Justin

Posted in AI, AIXPRT, benchmark, Benchmarking, BenchmarkXPRT, BenchmarkXPRT development community, Chromebooks, Cloud, CloudXPRT, Collaborative benchmark development, Future of performance evaluation, HDXPRT, History of benchmarking, Performance benchmarking | Also tagged AIXPRT, benchmark, BenchmarkXPRT, cloud applications, CloudXPRT, machine learning

HDXPRT 4: Troubleshooting an issue with the Convert Videos workload

By Justin Greene

on February 20, 2020

Yesterday, we received a report that an HDXPRT 4 tester encountered an error message during the Convert Videos workload. During the workload, HDXPRT uses HandBrake 1.2.2 and CyberLink MediaEspresso 7.5 to convert multiple videos to formats optimized for mobile phones.

The error message reports that the video files did not load correctly:

We apologize for the inconvenience that this causes for HDXPRT testers. We’re troubleshooting to determine the cause of the issue and will let the community know as soon as we identify a reliable solution. If you have any insight into this issue, or have encountered any other error messages during HDXPRT testing, please feel free to contact us!

Justin

Posted in benchmark, BenchmarkXPRT, HandBrake, HDXPRT, HDXPRT 4, MediaEspresso, Performance benchmarking, Video | Also tagged CyberLink, Handbrake, MediaEspresso, video

Tag Archives: HDXPRT

Following up on XPRT compatibility with Windows 11

Testing XPRT compatibility with Windows 11

Thinking ahead to the next HDXPRT

The ongoing evolution of the BenchmarkXPRT Development Community

Adapting to a changing tech landscape

HDXPRT 4: Troubleshooting an issue with the Convert Videos workload

Check out the other XPRTs: