Tag Archives: results

Celebrating 10 years of WebXPRT!

on March 30, 2023

We’re excited to announce that it’s been 10 years since the initial launch of WebXPRT! In early 2013, we introduced WebXPRT as a unique browser performance benchmark in a market space that was already crowded with a variety of specialized measurement tools. Our goal was to offer a benchmark that could compare the performance of almost any web-enabled device, using scenarios created to mirror real-world tasks. We wanted it to be a free, easily accessible, easy-to-run, useful, and appealing testing option for OEM labs, vendors, and the tech press.

When we look back on the last 10 years of WebXPRT, we can’t help but conclude that our efforts have been successful. Since those early days, the WebXPRT market presence has grown from humble beginnings into a worldwide industry standard. Hundreds of tech press publications have used WebXPRT in thousands of articles and reviews, and testers have now run the benchmark well over 1.1 million times.

Below, I’ve listed some of the WebXPRT team’s accomplishments over the last decade. If you’ve been following WebXPRT from the beginning, this may all be familiar, but if you’re new to the community, it may be interesting to see some of the steps that contributed to making WebXPRT what it is today.

We published four versions of the benchmark: WebXPRT 2013, WebXPRT 2015, WebXPRT 3, and WebXPRT 4.
We added subtests and updated existing workloads along the way to measure browser performance with newer HTML5, JavaScript, and WebAssembly technologies.
We added Simplified Chinese and German language options to the WebXPRT UI.
We added a WebXPRT host server in Singapore for testers in East Asia.
We published six WebXPRT white papers, along with three results calculation spreadsheets.
We published the WebXPRT: See how well your device handles common web tasks and What is WebXPRT and why should I care? videos.
We developed the WebXPRT 3 Processor Comparison Chart.
We developed the WebXPRT 4 results viewer tool.

In future blog posts, we’ll look at how the number of WebXPRT runs has grown over time, and how WebXPRT use has grown among OEMs, vendors, and the tech press worldwide. Do you have any thoughts that you’d like to share from your WebXPRT testing experience? If so, let us know!

Justin

Posted in benchmark, Benchmarking, BenchmarkXPRT, Browser-based benchmarks, Cross-platform benchmarks, German, History of benchmarking, JavaScript, Performance benchmarking, results, Simplified Chinese, tech press, WebAssembly, WebXPRT, WebXPRT 2013, WebXPRT 2015, WebXPRT 3, WebXPRT 4, WebXPRT Processor Comparison Chart, White papers | Also tagged browser, browser benchmark, browser performance, German, HTML5, JavaScript, Simplified Chinese, WebAssembly, WebXPRT, WebXPRT 2015, WebXPRT 3, WebXPRT 4, white paper

Looking back on 2022 with the XPRTs

By Justin Greene

on January 19, 2023

Around the beginning of each new year, we like to take the opportunity to look back and summarize the XPRT highlights from the previous year. Readers of our newsletter are familiar with the stats and updates we include each month, but for our blog readers who don’t receive the newsletter, we’ve compiled some highlights from 2022 below.

Benchmarks
In the past year, we released WebXPRT 4, and the CloudXPRT v1.2 update package.

XPRTs in the media
Journalists, advertisers, and analysts referenced the XPRTs thousands of times in 2022. It’s always rewarding to know that the XPRTs have proven to be useful and reliable assessment tools for technology publications around the world. Media sites that used the XPRTs in 2022 include AnandTech, Android Authority, Benchlife.info (China), BodNara (South Korea), ComputerBase (Germany), DISKIDEE (Belgium), eTeknix, Expert Reviews, Gadgets 360, Hardware.info (The Netherlands), Hardware Zone (Singapore), ITC.ua (Ukraine), ITmedia (Japan), Itndaily.ru (Russia), Notebookcheck, PCMag, PC-Welt (Germany), PCWorld, TechPowerUp, Tom’s Guide, TweakTown, and ZOL.com (China).

Downloads and confirmed runs
In 2022, we had more than 10,800 benchmark downloads and 183,300 confirmed runs. Users have run our most popular benchmark, WebXPRT, more than 1,135,500 times since its debut in 2013! WebXPRT continues to be a go-to, industry-standard performance benchmark for OEM labs, vendors, and leading tech press outlets around the globe.

XPRT media, tools, and publications
Part of our mission with the XPRTs is to produce tools and materials that help testers better understand the ins and outs of benchmarking in general and the XPRTs in particular. To help achieve this goal, we published the following in 2022:

an updated version of the WebXPRT 4 results viewer tool
the Exploring WebXPRT 4 white paper
the WebXPRT 4 results calculation and confidence interval white paper
a new XPRTs around the world infographic

We’re thankful for everyone who used the XPRTs, joined the community, and sent questions and suggestions throughout 2022. We’re excited to see what’s in store for the XPRTs in 2023!

Justin

Posted in AnandTech, benchmark, Benchmarking, BenchmarkXPRT, BenchmarkXPRT development community, CloudXPRT, results, WebXPRT, WebXPRT 2013, WebXPRT 4, White papers | Also tagged AnandTech, CloudXPRT, infographic, Notebookcheck, PCMag, PCWorld, tech press, Tom's Hardware, WebXPRT, WebXPRT 4, white paper

The XPRTs can help with your holiday shopping!

By Justin Greene

on November 3, 2022

The holiday shopping season is fast approaching, and choosing the right tech gift can often be a daunting task. If you’re considering phones, tablets, Chromebooks, or laptops as gifts, and are unsure where to get reliable device information, the XPRTs can help!

The XPRTs provide objective, reliable measures of a device’s performance that can help to cut through the marketing noise. For example, instead of guessing whether the performance of a new laptop lives up to its billing, you can use its WebXPRT performance score to see how it stacks up against the competition on everyday tasks.

A good place to start looking for device scores is our XPRT results browser, which lets you access our database of more than 3,200 test results from over 165 sources, including major tech review publications around the world, OEMs, and independent testers. You can find a wealth of current and historical performance data across all the XPRT benchmarks and hundreds of devices. Learn how to use the results browser here.

If you’re considering a popular device, chances are good that a recent tech review includes an XPRT score for it. You can find these reviews by going to your favorite tech review site and searching for “XPRT,” or entering the name of the device and the appropriate XPRT (e.g., “iPhone” and “WebXPRT”) in a search engine. Here are a few recent tech reviews that used the XPRTs to evaluate popular devices:

AnandTech used WebXPRT to evaluate the MSI Titan GT77 gaming laptop.
Notebookcheck used WebXPRT in reviews of the Apple iPhone 14 Plus, the ASUS ZenFone 9, Google Pixel 6a, and the Samsung Galaxy Z Fold4 5G.
Tom’s Guide used WebXPRT to test the Apple MacBook Pro (M1 2022).
PCMag used WebXPRT to evaluate the Apple MacBook Air (M2 20022) and Lenovo Legion 7 Gen 7 laptops.
PCWorld used WebXPRT in a review of the Microsoft Surface Pro 9.

The XPRTs can help consumers make better-informed and more confident tech purchases this holiday season, and we hope you’ll find the data you need on our site or in an XPRT-related tech review. If you have any questions about the XPRTs, XPRT scores, or the results database please feel free to ask!

Justin

Posted in AnandTech, Apple, benchmark, Benchmark metrics, BenchmarkXPRT, Chromebooks, Google, Laptops, PCs, Performance benchmarking, Phones, results, Tablets, WebXPRT | Also tagged AnandTech, Apple, ASUS, BenchmarkXPRT, BenchmarkXPRT Development Community, Google, Lenovo, Microsoft, Notebookcheck, PCMag, PCWorld, Samsung, Tom's Hardware, WebXPRT, WebXPRT 4

We have a new XPRTs around the world infographic!

By Justin Greene

on October 20, 2022

If you’ve followed the XPRT blog for a while, you know that we occasionally update the community on some of the reach metrics we track by publishing a new version of the “XPRTs around the world” infographic. The metrics we track include completed test runs, benchmark downloads, and mentions of the XPRTs in advertisements, articles, and tech reviews. Gathering this information gives us insight into how many people are using the XPRT tools, and updating the infographic helps readers and community members see the impact the XPRTs are having around the world.

This week, we published a new infographic, which includes the following highlights:

The XPRTs have been mentioned more than 19,500 times on over 4,000 unique sites.
Those mentions include more than 12,300 articles and reviews.
Users have tested gear with the XPRTs in over 924 cities located in 81 countries on six continents. New cities of note include Dhaka, Bangladesh; Zagreb, Croatia; Hamilton, New Zealand; and Medina, Saudi Arabia.

In addition to the reach metrics we mention above, the XPRTs have now delivered more than 1,330,000 real-world results! We’re grateful for everyone who’s helped us get this far. Your participation is vital to our achieving our goal: to provide benchmark tools that are reliable, relevant, and easy to use.

Justin

Posted in benchmark, Benchmarking, BenchmarkXPRT, BenchmarkXPRT development community, results, tech press | Also tagged benchmark, BenchmarkXPRT, BenchmarkXPRT Development Community, infographic, XPRTs

The Exploring WebXPRT 4 white paper is now available

By Justin Greene

on September 1, 2022

This week, we published the Exploring WebXPRT 4 white paper. It describes the design and structure of WebXPRT 4, including detailed information about the benchmark’s harness, HTML5 and WebAssembly (WASM) capability checks, and changes we’ve made to the structure of the performance test workloads. We explain the benchmark’s scoring methodology, how to automate tests, and how to submit results for publication. The white paper also includes information about the third-party functions and libraries that WebXPRT 4 uses during the HTML5 and WASM capability checks and performance workloads.

The Exploring WebXPRT 4 white paper promotes the high level of transparency and disclosure that is a core value of the BenchmarkXPRT Development Community. We’ve always believed that transparency builds trust, and trust is essential for a healthy benchmarking community. That’s why we involve community members in the benchmark development process and disclose how we build our benchmarks and how they work.

You can find the paper on WebXPRT.com and our XPRT white papers page. If you have any questions about WebXPRT 4, please let us know, and be sure to check out our other XPRT white papers.

Justin

Posted in Automation, benchmark, Benchmarking, BenchmarkXPRT, BenchmarkXPRT development community, Performance benchmarking, results, results submission, WebAssembly, WebXPRT, WebXPRT 3, WebXPRT 4, White papers | Also tagged benchmark, BenchmarkXPRT, BenchmarkXPRT Development Community, HTML5, results submission, WebAssembly, WebXPRT, WebXPRT 4, white paper

The XPRTs can help with your back-to-school shopping

By Justin Greene

on August 4, 2022

The new school year is upon us, and learners of all ages are looking for tech devices that have the capabilities they will need in the coming year. The tech marketplace can be confusing, and competing claims can be hard to navigate. The XPRTs are here to help! Whether you’re shopping for a new phone, tablet, Chromebook, laptop, or desktop, the XPRTs can provide reliable, industry-trusted performance scores that can cut through all the noise.

A good place to start looking for scores is the WebXPRT 4 results viewer. The viewer displays WebXPRT 4 scores from over 175 devices—including many hot new releases—and we’re adding new scores all the time. To learn more about the viewer’s capabilities and how you can use it to compare devices, check out this blog post.

Another resource we offer is the XPRT results browser. The browser is the most efficient way to access the XPRT results database, which currently holds more than 3,000 test results from over 120 sources, including major tech review publications around the world, OEMs, and independent testers. It offers a wealth of current and historical performance data across all of the XPRT benchmarks and hundreds of devices. You can read more about how to use the results browser here.

Also, if you’re considering a popular device, chances are good that a recent tech review includes an XPRT score for that device. Two quick ways to find these reviews: (1) go to your favorite tech review site and search for “XPRT” and (2) go to a search engine and enter the device name and XPRT name (e.g., “Apple MacBook Air” and “WebXPRT”). Here are a few recent tech reviews that use one of the XPRTs to evaluate a popular device:

Notebookcheck used WebXPRT in reviews of the Acer Swift X 16, Apple MacBook Air, ASUS ROG Flow X16, Lenovo V17G2, Nothing Phone (1); and a recent article titled, “The Best Smartphones.”
PCMag used WebXPRT 3 to compare the M1 Max and M1 Ultra versions of the Apple Mac Studio, and to review the Apple Macbook Air (2022, M2).
PCWorld used CrXPRT 2 in a feature called, “The best Chromebooks: Best overall, best battery life, and more.”
ZDNet used CrXPRT 2 in a review titled, “The 5 best Chromebooks for students: Top back-to-school picks.”

The XPRTs can help consumers make better-informed and more confident tech purchases. As this school year begins, we hope you’ll find the data you need on our site or in an XPRT-related tech review. If you have any questions about the XPRTs, XPRT scores, or the results database please feel free to ask!

Justin

Posted in Apple, benchmark, Benchmark metrics, Browser-based benchmarks, Chromebooks, CrXPRT, Education, Laptops, Mobile devices, Performance benchmarking, Phones, results, Tablets, WebXPRT, WebXPRT 3, WebXPRT 4 | Also tagged Acer, Apple, ASUS, Chromebooks, education, Lenovo, Notebookcheck, PCMag, PCWorld, school, WebXPRT, ZDNet

Tag Archives: results

Celebrating 10 years of WebXPRT!

Looking back on 2022 with the XPRTs

The XPRTs can help with your holiday shopping!

We have a new XPRTs around the world infographic!

The Exploring WebXPRT 4 white paper is now available

The XPRTs can help with your back-to-school shopping

Check out the other XPRTs: