BenchmarkXPRT Blog banner

Search Results for: results viewer

The WebXPRT 4 Preview is here!

Justin Greene
By Justin Greene
on December 20, 2021

We’re excited to announce that the WebXPRT 4 Preview is now available! Testers can access the Preview at www.WebXPRT4.com or through a link on WebXPRT.com. The Preview is available to everyone, and testers can now publish scores from Preview build testing. We may still tweak a few things, but will limit any changes that we make between the Preview and the final release to the UI and features we do not expect to affect test scores.

Longtime WebXPRT users will notice that the WebXPRT 4 Preview has a new, but familiar, UI. The general process for kicking off both manual and automated tests is the same as with WebXPRT 3, so the transition from WebXPRT 3 to WebXPRT 4 testing should be straightforward. We encourage everyone to visit the XPRT blog for more details about what’s new in this Preview release.

In addition, keep your eye on the blog for more details about the all-new WebXPRT 4 results viewer, which we expect to publish in the very near future. We think WebXPRT testers will enjoy using the viewer to explore our WebXPRT 4 test data!

After you try the WebXPRT 4 Preview, please send us your comments. Thanks and happy testing!

Justin

Posted in benchmark, Benchmarking, BenchmarkXPRT, Browser-based benchmarks, Cross-platform benchmarks, Performance benchmarking, Performance of computing devices, results, Web-based testing, WebXPRT, WebXPRT 3, webxprt 4 | Tagged , , , , , , |

Improving WebXPRT-related tools and resources

Justin Greene
By Justin Greene
on August 5, 2021

As we move forward with the WebXPRT 4 development process, we’re also working on ways to enhance the value of WebXPRT beyond simply updating the benchmark. Our primary goal is to expand and improve the WebXPRT-related tools and resources we offer at WebXPRT.com, starting with a new results viewer.

Currently, users can view WebXPRT results on our site two primary ways, each of which has advantages and limitations.

The first way is the WebXPRT results viewer, which includes hundreds of PT-curated performance scores from a wide range of trusted sources and devices. Users can sort entries by device type, device name, device model, overall score, date of publication, and source. The viewer also includes a free-form filter for quick, targeted searches. While the results viewer contains a wealth of information, it does not give users a way to use graphs or charts for viewing and comparing multiple results at once. Another limitation of the current results viewer is that it offers no easy way for users to access the additional data about the test device and the subtest scores that we have for many entries.

The second way to view WebXPRT results on our site is the WebXPRT Processor Comparison Chart. The chart uses horizontal bar graphs to compare test scores from the hundreds of published results in our database, grouped by processor type. Users can click the average score for a processor to view all the WebXPRT results we currently have for that processor. The visual aspect of the chart and its automated “group by processor type” feature are very useful, but it lacks the sorting and filtering capabilities of the viewer, and navigating to the details of individual tests takes multiple clicks.

In the coming months, we’ll be working to combine the best features of the results viewer and the comparison chart into a single powerful WebXPRT results database tool. We’ll also be investigating ways to add new visual aids, navigation controls, and data-handling capabilities to that tool. We want to provide a tool that helps testers and analysts access the wealth of WebXPRT test information in our database in an efficient, productive, and enjoyable way. If you have ideas or comments about what you’d like to see in a new WebXPRT results viewing tool, please let us know!

Justin

Posted in benchmark, Browser-based benchmarks, Cross-platform benchmarks, Performance benchmarking, results, results submission, Web-based testing, WebXPRT, WebXPRT 3, webxprt 4, WebXPRT Processor Comparison Chart | Tagged , , , , |

AIXPRT Community Preview 2 is almost here!

Justin Greene
By Justin Greene
on May 9, 2019

In last week’s blog, we predicted that the second AIXPRT Community Preview (CP2) would be ready for release later this month. Since then, the development process has accelerated, and we now expect to release CP2 as early as tomorrow, May 10.

Those who have access to the existing AIXPRT Community Preview GitHub repository will be able to access CP2 the same way as before. In addition to making the build available on GitHub, we’ll also post CP2 on an AIXPRT tab in the XPRT Members’ Area (login required). If you don’t have a BenchmarkXPRT Development Community membership, please contact us and we’ll help you register.

Testing with AIXPRT CP2 in Ubuntu will be the same as with the first CP, and none of the CP2 changes will affect results. In Windows, testers will be able to use OpenVINO to target a system’s CPU and GPU, and TensorFlow to target CPUs. We’re still investigating ways to support TensorFlow GPU and TensorFlow-TensorRT testing in Windows.

We’re also continuing to work on the improvements to the AIXPRT results viewer that we mentioned last week. We won’t be able to implement all of the changes by tomorrow, but rather than waiting until we’re finished, we’ll be rolling out improvements as they become ready.

We’ll continue to keep everyone up to date with AIXPRT news here in the blog. If you have any questions or comments, please let us know.

Justin

Posted in AI, AIXPRT, BenchmarkXPRT, BenchmarkXPRT development community, Collaborative benchmark development, Community Preview, Cross-platform benchmarks, GitHub, Machine learning, OpenVINO, Performance benchmarking, TensorFlow, TensorRT, Ubuntu | Tagged , , , , , , , , |

An update on AIXPRT development

Bill Catchings
By Bill Catchings
on May 2, 2019

It’s been almost two months since the AIXPRT Community Preview went live, and we want to provide folks with a quick update. Community Preview periods for the XPRTs generally last about a month. Because of the complexity of AIXPRT and some of the feedback we’ve received, we plan to release a second AIXPRT Community Preview (CP2) later this month.

One of the biggest additions in CP2 will be the ability to run AIXPRT on Windows. AIXPRT currently requires test systems to run Ubuntu 16.04 LTS. This is fine for testers accustomed to Linux environments, but presents obstacles for those who want to test in a traditional Windows environment. We will not be changing the tests themselves, so this update will not influence existing results from Ubuntu. We plan to make CP2 available for download from the BenchmarkXPRT website for people who don’t wish to deal with GitHub.

Also, after speaking with testers and learning more about the kinds of data points people are looking for in AIXPRT results, we’ve decided to make significant adjustments to the AIXPRT results viewer. To make it easier for visitors to find what they’re looking for, we’ll add filters for key categories such as batch size, toolkit, and latency percentile (e.g., 50th, 90th, 99th), among others. We’ll also allow users to set desired ranges for metrics such as throughput and latency.

Finally, we’re adding a demo mode that displays some images and other information on the screen while a test is running to give users a better idea what is happening. While we haven’t seen results change while running in demo mode, users should not publish demo results or use them for comparison.

We hope to release CP2 in the second half of May and a GA version in mid-June. However, this project has more uncertainties than we usually encounter with the XPRTs, so that timeline could easily change.

We’ll continue to keep everyone up to date with AIXPRT news here in the blog. As always, we appreciate your suggestions. If you have any questions or comments about AIXPRT, please let us know.

Bill

Posted in AI, AIXPRT, Benchmarking, BenchmarkXPRT development community, Collaborative benchmark development, Community Preview, Cross-platform benchmarks, Future of performance evaluation, Linux, Machine learning, OpenVINO, Performance benchmarking, TensorFlow, TensorRT, Ubuntu | Tagged , , , , |

The TouchXPRT 2016 Community Preview is here!

Eric Hale
By Eric Hale
on November 13, 2015

Today we are releasing the TouchXPRT 2016 Community Preview (CP). TouchXPRT 2016 includes the same performance workloads as TouchXPRT 2014, but we have rebuilt it as a Universal Windows app. This makes TouchXPRT 2016 compatible with systems running Windows 10 and Windows 10 Mobile.

Because this is a community preview, it is available only to community members. Members may download the preview from the TouchXPRT tab in the Members’ Area.

The results viewer in the TouchXPRT 2016 CP is not fully functional. Please consult the release notes for further details (login required).

After you try out the CP, please send your comments. Either post them to the forum or mail them to BenchmarkXPRTsupport@principledtechnologies.com. If you send us information that’s relevant to the entire community, we may post an anonymous version of your comments to the forum.

Thanks for your participation!

Posted in BenchmarkXPRT development community, Collaborative benchmark development, Community Preview, TouchXPRT, TouchXPRT 2016, TouchXPRT development process, TouchXPRT release cycle, Windows 10 |

You wanted it? You got it!

Eric Hale
By Eric Hale
on February 6, 2014

As Bill said in Endurance, when we asked what new benchmark people most wanted to see, battery life was number one. Over the past few months, we’ve announced that we’re developing a battery benchmark, solicited input from the community, and have been hard at work developing BatteryXPRT 2014 for Android.

I’m happy to announce that we’re releasing BatteryXPRT 2014 for Android Community Preview 1 (CP1) later this week. CP1, as its name makes clear, is not the final BatteryXPRT 2014 for Android release. There’s still a lot of work to do on the user interface and the new results viewer. However, it’s a great way for everyone in the community to see the current state of our thinking and to provide us with feedback. You can run this version of the tool and see what you think!

As we’ve done with previous community previews, we’re also taking two more steps:

  • We’re not putting any publication restrictions on this preview release. Test at will, and publish your findings.
  • We’re releasing the source code to all community members. If you’re curious about not just what we’re doing but how we’re doing it, you can find out.

As the design document explains, BatteryXPRT 2014 for Android can estimate battery life in less than 6 hours. You can also use it as a rundown test if you prefer. In addition, CP1 is the first of our benchmarks to use the new UI design. Here’s a peek:

BatteryXPRT CP1 home screen

As you can see from the screenshot, you can run the test in Airplane mode or connected to the network. There are other cool features we’ll be talking about once CP1 is available.

We’re really excited about this one. I can’t wait!

Eric

Comment on this post in the forums

Posted in Android, BatteryXPRT 2014 for Android, Collaborative benchmark development, Community Preview |

Check out the other XPRTs:

Forgot your password?
© Principled Technologies, Inc. 2024   |   Privacy policy

Cookie Notice: Our website uses cookies to deliver a smooth experience by storing logins and saving user information. By continuing to use our site, you agree with our usage of cookies as our privacy policy outlines.

x