Tag Archives: Android

XPRT mentions in the tech press

on April 4, 2024

One of the ways we monitor the effectiveness of the XPRT family of benchmarks is to regularly track XPRT usage and reach in the global tech press. Many tech journalists invest a lot of time and effort into producing thorough device reviews, and relevant and reliable benchmarks such as the XPRTs often serve as indispensable parts of a reviewer’s toolkit. Trust is hard-earned and easily lost in the benchmarking community, so we’re happy when our benchmarks consistently achieve “go-to” status for a growing number of tech assessment professionals around the world.

Because some of our newer readers may be unaware of the wide variety of outlets that regularly use the XPRTs, we occasionally like to share an overview of recent XPRT-related tech press activity. For today’s blog, we want to give readers a sampling of the press mentions we’ve seen over the past few months.

Recent mentions include:

AnandTech used WebXPRT 4 to assess the performance of the ASRock Industrial 4X4 BOX-7840U and GEEKOM A5 mini-PCs.
Android Headlines used CrXPRT 2 to measure the performance of the ASUS Chromebook Plus CX34.
Mashable measured the performance and battery life of the HP Chromebook Plus x360 14c with CrXPRT 2.
Notebookcheck used WebXPRT 4 in dozens of device reviews, including evaluations of the Apple MacBook Air 15 (M3, 2024), the HP Omen 16 (2024), the HP Spectre x360 16, the Lenovo ThinkPad X1 Carbon G12, and the Valve Steam Deck.
PCMag used WebXPRT 4 in a review of the Apple MacBook Air 15 (M3, 2024).
TechPowerUp used WebXPRT 4 in a review of the Intel Core i9-14900KS processor.
Tom’s Guide used WebXPRT 4 to compare the performance of the Snapdragon and Exynos variants of the Samsung Galaxy S24.
Other outlets that have published articles, ads, or reviews mentioning the XPRTs in the last few months include: 3DNews (Russia), Android Authority, Benchlife.info, Delkom (Poland), DigitalWorld Italia, Digitec (Switzerland), Expert Reviews, Galaxus (Germany), Hardware.info, HIPC (Japan), ITC.ua (Ukraine), ITWorld (Korea), iXBT.com (Russia), PCMag, PC-Welt (Germany), QQ.com (China), SMZDM (China), and Tweakers.

Each month, we send out a BenchmarkXPRT Development Community newsletter that contains the latest updates from the XPRT world and provides a summary of the previous month’s XPRT-related activity, including new mentions of the XPRTs in the tech press. If you don’t currently receive the monthly BenchmarkXPRT newsletter but would like to join the mailing list, please let us know! There is no cost to join, and we will not publish or sell any of the contact information you provide. We will send only the monthly newsletter and occasional benchmark-related announcements, such as news about patches or new releases.

Justin

Posted in AnandTech, Apple, ASUS, battery life, benchmark, Benchmark metrics, Benchmarking, BenchmarkXPRT, BenchmarkXPRT development community, Chromebooks, CrXPRT, HP, Lenovo, Performance benchmarking, Performance of computing devices, Samsung, tech press, What makes a good benchmark? | Also tagged AnandTech, Apple, ASRock, ASUS, GEEKOM, HP, Intel, Lenovo, Mashable, Notebookcheck, PCMag, PCWorld, Samsung, TechPowerUp, Tom's Hardware, WebXPRT, WebXPRT 4

Support for MobileXPRT 3 will likely end soon

By Justin Greene

on October 20, 2023

In a past blog post, we discussed our plan to move several older versions of XPRT benchmarks to an XPRT archive page. Some of those legacy XPRTs still function correctly, and testers occasionally use them, but a few no longer work on the latest versions of the operating systems or browsers that we designed them to test. With the archive page, we can prevent potential confusion for new users who visit current XPRT pages, but still provide longtime users with continued access to old tests.

You can find more information about the XPRTs that we’ll be moving to the archive page here, but today, we want to let MobileXPRT users know that there’s a high likelihood that MobileXPRT 3 will be joining the list of archived XPRTs in the very near future. The Google Play Store has notified us that, due to evolving requirements for apps in newer versions of Android, we must update our MobileXPRT 3 app package to target an Android API level within one year of the latest Android release. If we don’t update the app to meet that requirement by November 1, users will no longer be able to access MobileXPRT 3 through the Google Play Store.

Though a small number of labs and reviewers still use MobileXPRT 3 to test phones and tablets around the world, we don’t feel current usage is high enough for us to justify committing resources to an update at this point. We had hoped that even if MobileXPRT 3 became inaccessible via the Google Play Store, it would still be possible to sideload the app for testing on newer Android devices. After experimenting with installation options in the lab, however, we think it’s likely that settings on devices running Android 11 and up will prevent both Google Play and sideload installations after November 1. The situation may change, but right now, we don’t expect any method to work after that date. If you try, you’ll likely encounter a message during the installation process that says, “This app was built for an older version of Android and may not work properly. Try checking for updates, or contact the developer.” If you attempt to continue the installation process after that message appears, the app will crash.

Both Android and Chrome developers know that the respective stores sometimes extend these types of deadlines. We hope that will be the case here, but we have no information that would lead us to anticipate an extension. If there is no extension, we will still make MobileXPRT 3 available for testing on older Android devices, but we will then have to move it to the XPRT archive page.

We’re grateful for everyone who has used MobileXPRT 3 in the past, and we apologize for any convenience this change may cause. If you have any questions or concerns about MobileXPRT 3 access, please let us know!

Justin

Posted in Android, Android 11, Benchmarking, BenchmarkXPRT, Google, Google Chrome, Google Play Store, Mobile devices, MobileXPRT, MobileXPRT 3, Performance testing on tablets, Phones | Also tagged Android 11, API, Chrome, Google Play Store, MobileXPRT, MobileXPRT 3, phones, tablets

CrXPRT 2 on FydeOS!

By Justin Greene

on April 28, 2022

Recently, a tester contacted us with details from a CrXPRT 2 performance test run that they’d successfully completed on… an Apple MacBook Pro! Because CrXPRT 2 is a Chrome Web App that we designed for Chrome OS, it was quite a surprise to hear that it is now possible to run CrXPRT 2 on non-Chrome OS platforms by using FydeOS.

FydeOS is an operating system based on a fork of the Chromium OS project. Developers originally intended FydeOS to be a Google-independent, Chrome-like alternative for the Chinese educational market, but FydeOS is now available to the English-speaking consumer and enterprise markets as well. FydeOS users can run a Chrome-like OS on something other than a Chromebook or a Chromebox, such as a PC, Mac, virtual machine, or even a Raspberry Pi device. Additionally, FydeOS supports Android, Chrome OS, and Linux apps, and users can run those apps at the same time on the same screen.

We have not yet conducted any testing with FydeOS in our lab, but we wanted to pass along this information to any readers who may be interested. If the OS operates as described, it may provide a way for us to experiment with using CrXPRT 2 in some interesting cross-platform tests.

Justin

Posted in Android, Apple, benchmark, Benchmarking, Browser-based benchmarks, Chrome OS, Chromebooks, Cross-platform benchmarks, CrXPRT, FydeOS, Google, Google Chrome, Linux, Performance benchmarking, Raspberry Pi | Also tagged Apple, Chrome, Chrome OS, cross-platform, CrXPRT, CrXPRT 2, FydeOS, Linux, Raspberry Pi

We’ve updated MobileXPRT 3 to address issues with Android 11

By Justin Greene

on December 3, 2020

This week, we published an updated MobileXPRT 3 build, version 3.116.0.4, on MobileXPRT.com and in the Google Play Store. The new build addresses an issue we recently discovered, where MobileXPRT was crashing after installation on some Android 11 phones. Permissions requirements and a new storage strategy called scoped storage were causing the problem. By default, scoped storage restricts an app’s storage access to app-specific directories and media, and prohibits general access to external or public directories. It also prevents third-party apps such as email clients or file managers from accessing MobileXPRT 3 results files. This default setting requires an opt-in permissions prompt that MobileXPRT 3 did not have prior to this week’s release.

MobileXPRT 3.116.0.4 points all of the benchmark’s file references to its private directory and allows users to zip results files and attach them to results submission emails. Neither change affects the testing process or test scores. If you have any questions or comments about the new MobileXPRT 3 build, please let us know!

Justin

Posted in Android, Android 11, benchmark, Google, Performance benchmarking, Performance testing on tablets, Phones, Storage | Also tagged Android 11, Google, Google Play Store, MobileXPRT, MobileXPRT 3

Following up with MobileXPRT 3 on Android 11

By Justin Greene

on October 22, 2020

As we discussed last week, we’ve learned that MobileXPRT 3 is crashing after installation on some Android 11 phones. We now know what is causing this behavior: changes to the storage strategy and permissions requirements in Android 11. The new file storage strategy is called scoped storage. By default, scoped storage restricts an app’s storage access to app-specific directories and media, and prohibits general access to external or public directories. This default setting requires an opt-in permissions prompt that MobileXPRT 3 does not currently have. It also prevents third-party apps such as email clients or file managers from being accessing MobileXPRT 3 results files.

To fix this, we are planning to rebuild MobileXPRT 3 to (1) point all of the benchmark’s file references to its private directory, and (2) allow users to zip results files and attach them to results submission emails. While we do not expect that either of these changes will affect performance results, we’ll perform testing to confirm this before we publish the new build.

We don’t expect these changes to take too long, and will keep you updated here in the blog. If you have any questions about the update process or MobileXPRT 3, please let us know!

Justin

Posted in Android 11, benchmark, Mobile devices, MobileXPRT, MobileXPRT 3, Phones, Tablets | Also tagged Android 11, mobile devices, MobileXPRT, MobileXPRT 3

New MobileXPRT 3 installations may crash on Android 11

By Justin Greene

on October 15, 2020

We recently received a tech support inquiry about problems with new MobileXPRT 3 installations on some Android 11 phones. The tester installed MobileXPRT 3 on a selection of phones running Android 11, and the app crashed immediately upon opening. We were able to reproduce the issue on multiple phones in our lab, and currently know that the issue may happen on the Google Pixel 3, Google Pixel 4a 5G, Google Pixel 4XL, Google Pixel 5, and the OnePlus 8T (running Android 11 with an Oxygen OS skin).

MobileXPRT 3 continues to run without issues on Android 9 and 10 phones. When we updated an Android 10 phone with an existing MobileXPRT 3 installation to Android 11, we found that the benchmark ran successfully. This suggests a lack of fundamental incompatibilities between MobileXPRT 3 and current versions of Android 11. Because some of our lab techs experienced crashes immediately after the app asked for permissions, we think it’s possible that new permissions-setting requirements in Android 11 are causing the problem.

We’re currently working to isolate the problem and identify a course of action. We’ll share more information here in the blog as soon as possible. If you’ve encountered this problem in your testing, we apologize for the inconvenience, and we’re thankful for your patience as we work towards a solution.

If you have any information you’d like to share about running MobileXPRT 3 on Android 11, please let us know!

Justin

Posted in Android, Android 10, Android 11, Android 9, benchmark, Benchmarking, Google, Mobile devices, MobileXPRT, MobileXPRT 3, Performance benchmarking, Phones, Tablets | Also tagged Android 10, Android 11, Android 9, Google Pixel, mobile devices, MobileXPRT, MobileXPRT 3, OnePlus, phones, tablet

Tag Archives: Android

XPRT mentions in the tech press

Support for MobileXPRT 3 will likely end soon

CrXPRT 2 on FydeOS!

We’ve updated MobileXPRT 3 to address issues with Android 11

Following up with MobileXPRT 3 on Android 11

New MobileXPRT 3 installations may crash on Android 11

Check out the other XPRTs: