BenchmarkXPRT Blog banner

Category: Performance benchmarking

MobileXPRT 2015 is here!

Eric Hale
By Eric Hale
on August 28, 2015

Today, we’re releasing MobileXPRT 2015, the latest version of our tool for evaluating the performance of Android devices. The BenchmarkXPRT Development Community has been using a community preview for several weeks, but now anyone can run MobileXPRT and publish their results.

MobileXPRT 2015 is compatible with systems running Android 4.4 and above. It is a 64-bit app, but will work on both 32-bit and 64-bit hardware. The new release includes the same performance workloads as MobileXPRT 2013, but not the UX Tests. If you need the UX tests, MobileXPRT 2013 will continue to be available here.

MobileXPRT 2015 is available at MobileXPRT.com and on the Google Play store. Alternatively, you can download the app using either of the links below:

 

After trying out MobileXPRT 2015, please submit your scores here and send any comments to BenchmarkXPRTsupport@principledtechnologies.com.  We’re eager to hear and see how you’ll use this tool!

Posted in Android, BenchmarkXPRT development community, MobileXPRT, MobileXPRT 2015, Performance benchmarking, Performance testing on tablets |

Mystery solved

Eric Hale
By Eric Hale
on July 2, 2015

As we mentioned a few weeks ago, the WebXPRT Local Notes test would not complete on recent builds of Windows 10 when using the Edge browser. Other browsers complete WebXPRT in recent Windows 10 builds without any problems.

We now know what is causing this behavior. The Local Notes test stores encrypted content in LocalStorage as UTF-16 character encoded Unicode strings. The encrypted content included values that are not considered valid characters in certain use cases.  The current Edge implementation treats these characters as undefined and cannot store them. Other browsers may not have had an issue with the characters because of differences in the way they implement LocalStorage.

We’ve been able to work around this by using escape sequences for unsupported Unicode code points.  Testing so far has not shown any perceptible change in results, so we believe that we will able to make this change to WebXPRT without compromising the comparability of the results.

Because this issue affects both WebXPRT 2013 and WebXPRT 2015, we’re planning to update both versions. We’ll let you know as soon as they are available.

If you’d like more details about this issue and the fix, please let us know.

Eric

Posted in Performance benchmarking, WebXPRT, WebXPRT 2015, What makes a good benchmark?, Windows 10 |

Hoping for a perfect 10

Eric Hale
By Eric Hale
on June 18, 2015

As many of you know by now, the release date for Windows 10 is July 29. As we’ve said before, we are hard at work getting TouchXPRT ready for Windows 10. We’ve succeeded in building TouchXPRT as a universal app, and it’s now running on Windows 10. We haven’t successfully run it on Windows 10 Phone yet, but we’re working on that.

Unfortunately, I can’t share any performance data. The EULA for the current build of Windows 10 (build 10143 as I’m writing this) forbids publishing benchmark results without prior written approval from Microsoft.

We’ll continue testing and refining the porting of TouchXPRT to Windows 10. Our goal is to release it as a universal app to the community in July.

What are your experiences testing Windows 10?  We’d love to hear about them!

Eric

Posted in Performance benchmarking, TouchXPRT, TouchXPRT development process, TouchXPRT release cycle, Windows 10 |

WebXPRT 2015 is here!

Eric Hale
By Eric Hale
on May 8, 2015

Today, we’re releasing WebXPRT 2015, our benchmark for evaluating the performance of Web-enabled devices. The BenchmarkXPRT Development Community has been using a community preview for several weeks, but now that we’ve released the benchmark, anyone can run WebXPRT and publish results.

Run WebXPRT 2015

WebXPRT 2013 is still available here while people transition to WebXPRT 2015. We will provide plenty of notice before discontinuing WebXPRT 2013.

After trying out WebXPRT, please send your comments to BenchmarkXPRTsupport@principledtechnologies.com.

Posted in Automation, BenchmarkXPRT development community, Performance benchmarking, Performance of computing devices, Performance testing on tablets, WebXPRT, WebXPRT 2015 |

More power, more control

Eric Hale
By Eric Hale
on March 19, 2015

As I said last week, the community preview for WebXPRT 2015 is coming up soon. One of the changes that will be exciting to anyone who does a lot of testing is that we made it simpler to automate WebXPRT tests.

WebXPRT 2015 will let you automatically select any set of tests you want to run. However, as always, you must run the entire suite of tests to get an overall score. Although the community preview will not include any experimental tests, the automation includes control for those future tests as well.

You may choose from several output formats: HTML table, XML, and CSV, or you can download the results as a text file.

Using the automation is simple: you just append the desired test parameters to the end of the URL. The format allows you to mix and match a lot of options, while still being very concise. The details will be in the release notes.

As people who test a lot of devices, we are very excited about this new capability.

Eric

Posted in Automation, BenchmarkXPRT development community, Collaborative benchmark development, Community Preview, Future of performance evaluation, Performance benchmarking, WebXPRT, What makes a good benchmark? |

An updated MobileXPRT 2013 build is available

Eric Hale
By Eric Hale
on February 20, 2015

Today we’re releasing a new build of MobileXPRT 2013 (b93) at MobileXPRT.com and the Google Play store. The build fixes a problem reported by a reviewer testing the LG G3. The device was going to sleep during the performance test, and causing MobileXPRT to crash after waking up. We’ve seen this problem only on the LG G3, but it may occur on other devices as well.

The new MobileXPRT build keeps the screen active during the run. Scores from this build are comparable with previous MobileXPRT scores.

Click here to download the new MobileXPRT installer (250 MB) directly from our site.

For users who have limited bandwidth or trouble accessing the Google Play store, downloading the APK files (16.9 MB total) may make installation easier.

Download the updated MobileXPRT APK (10.3 MB) directly from our site.

Download the updated MobileXPRT UX Tests APK (7.6 MB) directly from our site.

If you have any questions about the update or any other XPRT-related topic, feel free to contact us at BenchmarkXPRTsupport@principledtechnologies.com.

Posted in Android, BenchmarkXPRT development community, MobileXPRT, Performance benchmarking, Performance testing on tablets |

Check out the other XPRTs:

Forgot your password?
© Principled Technologies, Inc. 2024   |   Privacy policy

Cookie Notice: Our website uses cookies to deliver a smooth experience by storing logins and saving user information. By continuing to use our site, you agree with our usage of cookies as our privacy policy outlines.

x