Search Results for: webxprt

More power, more control

on March 19, 2015

As I said last week, the community preview for WebXPRT 2015 is coming up soon. One of the changes that will be exciting to anyone who does a lot of testing is that we made it simpler to automate WebXPRT tests.

WebXPRT 2015 will let you automatically select any set of tests you want to run. However, as always, you must run the entire suite of tests to get an overall score. Although the community preview will not include any experimental tests, the automation includes control for those future tests as well.

You may choose from several output formats: HTML table, XML, and CSV, or you can download the results as a text file.

Using the automation is simple: you just append the desired test parameters to the end of the URL. The format allows you to mix and match a lot of options, while still being very concise. The details will be in the release notes.

As people who test a lot of devices, we are very excited about this new capability.

Eric

Posted in Automation, BenchmarkXPRT development community, Collaborative benchmark development, Community Preview, Future of performance evaluation, Performance benchmarking, WebXPRT, What makes a good benchmark? |

Getting closer

By Eric Hale

on March 12, 2015

Mobile World Congress ended last week. If you’ve been following us on Twitter, you know that Bill had some really good meetings while he was there. That’s not to say that Bill didn’t have some fun too!

Next, we go to Intel Developer Forum 2015 – Shenzhen!

While Bill has been out of the country, we’ve been continuing to work on WebXPRT 2015. We’ve talked before about some of the improvements the new WebXPRT: new and more-demanding tests, on-screen descriptions of the tests, a progress indicator, and more. We’ve also given the UI a sleeker, more modern look. Also, WebXPRT 2015 will be the second XPRT to include a Chinese UI.

Testing has been going well. We have a few final tweaks to make but are expecting to release the community preview for WebXPRT 2015 in the next week or two. We’re really excited! I can’t wait to hear what you think of it.

Eric

Posted in IDF, Mobile World Congress, Simplified Chinese, Trade Shows, WebXPRT |

Back to Barcelona

By Eric Hale

on February 26, 2015

It’s time for one of Bill’s favorite shows of the year. Mobile World Congress (MWC) starts Monday in Barcelona. Talking about technology in Barcelona, now that’s a plum assignment!

Bill’s got a lot to talk about. Since last year’s MWC, here’s some of what’s happened:

We released two new benchmarks to the public, BatteryXPRT 2014 for Android and CrXPRT 2015.
We released updates to two benchmarks, TouchXPRT 2014 and HDXPRT 2014.
We created our first training course, for BatteryXPRT.
We released two videos Mine is better: TouchXPRT 2014 and CrXPRT in action.

(more…)

Posted in BatteryXPRT 2014 for Android, BenchmarkXPRT development community, CrXPRT, HDXPRT 2014, Mobile World Congress, TouchXPRT 2014, Trade Shows |

A guest blog from Wilson Cheng at Acer Inc.

By Wilson Cheng

on February 12, 2015

Two years ago, I got a job to evaluate cross-platform benchmarks for comparing Windows and Android.

Usually, Web-based benchmarks focus on only Java-script and HTML5 functionality. I found WebXPRT is easy to use and includes the tasks that you do every day. It reliably tests the user experience and gives a simple score for comparison. I suggested to our manager that we use it to evaluate our platform and he agreed.

Recently, Chromebooks have become very popular. Testing the battery life of Chromebooks has been difficult because you have needed to use the power_LoadTest image from the Chromium project or the test image from the Chrome OS Partners Web site to do power load testing. Without reimaging the system, you couldn’t test battery life. Because CrXPRT is designed to test battery life as well as performance on ChromeOS, this extra step is no longer needed. We can run CrXPRT without updating the test image, which is very useful in our battery life testing.

The advantage of XPRT benchmarks is that they are easy to use and give real-world results. The disadvantage is that they are not yet popular on review sites.

Posted in Android, BenchmarkXPRT, Chrome OS, Chromebooks, CrXPRT, Google Chrome, WebXPRT, What makes a good benchmark? |

A first look

By Eric Hale

on January 29, 2015

The beta build of WebXPRT 2015 is complete. Although the benchmark is still under development, it looks great!

As we described in the design document, it includes a number of improvements over WebXPRT 2013. There are more, and more demanding, tests. The UI has a cleaner, more modern look, and includes a couple of improvements people have been asking for. There is now descriptive text so that you know what’s happening during the test. Also, a progress indicator in the upper right corner shows you how close the test is to completion. Although the screens aren’t final, here’s a preview of one of the new DNA Sequence Analysis test screens:

One of the great virtues of WebXPRT is that it runs on almost anything. However, that level of compatibility has limited the range of devices WebXPRT can test. WebXPRT 2015 introduces a set of experimental tests. Running these tests is optional and their results are not included in the Overall Score. We hope that folks will use them to evaluate both new technologies and platform-specific technologies. The first Community Preview will include a WebGL-based 3D experimental test. We expect to add new experimental tests over time and we’re hoping community members will contribute tests or ideas for them.

I’m very excited to see the new WebXPRT. We’re testing now, and I hope to be able to let you know when the Community Preview will be available soon.

Eric

Posted in BenchmarkXPRT development community, Community Preview, WebGL, WebXPRT, WebXPRT 2015 |

Welcome to 2015

By Eric Hale

on January 8, 2015

Happy 2015! We hope that you all had a wonderful holiday season. I certainly did.

Back at the beginning of December, we talked about an intermittent problem that BatteryXPRT was having on the Nexus 9. We fixed the problem shortly after that, but delayed the release to test it on Android 5.01. The testing is complete, and we’ll be releasing BatteryXPRT 2014 v102 next week. As before, it will be available from Google Play and from the BatteryXPRT.com page.

In the last blog post, we recapped come of the highlights of 2014. Moving forward into 2015, WebXPRT 2015 is in development and we’re thinking ahead to the next version of MobileXPRT. We’ll be at Mobile World Congress in March, and at IDF China in April. We’ll tell you about our plans for those conferences over the next few weeks. If you’re planning to be at either of those shows, let us know! We’d love to talk to you.

We’re also planning some exciting new things in 2015. We can’t talk about them yet, but, personally, I can’t wait!

Wishing you all the best in the New Year!

Eric

Comment on this post in the forums

Posted in Android, BatteryXPRT 2014 for Android, IDF, Mobile World Congress, MobileXPRT |

Search Results for: webxprt

More power, more control

Getting closer

Back to Barcelona

A guest blog from Wilson Cheng at Acer Inc.

A first look

Welcome to 2015

Check out the other XPRTs: