BenchmarkXPRT Blog banner

Category: WebXPRT

WebXPRT 2015 is here!

Today, we’re releasing WebXPRT 2015, our benchmark for evaluating the performance of Web-enabled devices. The BenchmarkXPRT Development Community has been using a community preview for several weeks, but now that we’ve released the benchmark, anyone can run WebXPRT and publish results.

Run WebXPRT 2015

WebXPRT 2013 is still available here while people transition to WebXPRT 2015. We will provide plenty of notice before discontinuing WebXPRT 2013.

After trying out WebXPRT, please send your comments to BenchmarkXPRTsupport@principledtechnologies.com.

WebXPRT 2015

Tomorrow we’ll be releasing WebXPRT 2015, with mirror site in Singapore to follow soon. We’ve been talking about it for a while and we’re delighted to finally make it available to the public.

As we’ve discussed over the past few weeks, the new WebXPRT is a big improvement over WebXPRT 2013. Some of the changes are

  • An improved UI. In addition to a cleaner, sleeker look, the UI now has a progress indicator and on-screen test descriptions. There is also a Simplified Chinese version of the UI.
  • Test automation. WebXPRT 2015 lets you automate testing, giving labs more flexibility and making it easier to test lots of devices.
  • New and improved tests. In addition to enhancing the existing tests, WebXPRT 2015 adds two new tests, Explore DNA Sequencing and Sales Graphs.

 

If you haven’t checked out the new WebXPRT, now is the time!

And remember the design document for the next generation of MobileXPRT should be out by the end of the month. If there are things you would like to see, it’s a great time to let us know.

Eric

Looking at the data

We’re planning the general release of WebXPRT 2015 for late next week. The testing is looking good and the response has been positive.

We’ve been looking at the hundreds of runs in the database for the community preview.  As we’ve said before, we’ve been looking at the information from the JavaScript navigator object in the hope that we could improve the disclosure information from WebXPRT 2015. However, the information is not reliable enough for us to use it at this time. Hopefully, that will improve in the near future.

For now, we will continue to use the information from the user agent string. We’ve discussed the user agent string before. It does give us some information about the device, although not as much as we are able to gather in some of the XPRTs.

Looking at the data, the most common OS has been Windows. This may be in part because you needed to be logged in to run the CP. However, Android devices represented over a third of the runs, and Chrome OS represented about 25 percent of the runs. While we had healthy numbers of iOS devices, there were only a handful of Mac OSX runs.  Chrome was the most common browser. Other browsers identified themselves as Safari, Firefox, Opera, and MS IE.

As you can see, the new WebXPRT continues the tradition that WebXPRT 2013 started of running everywhere. We can’t wait to make it available to general public!

Eric

Lots of things are happening!

The WebXPRT 2015 community preview hasn’t even been out two weeks yet, but there are already hundreds of runs in the database. If you haven’t checked it out yet, now is a good time! (login required)

As I mentioned last week, Bill and Justin are at Intel Developer Forum 2015 – Shenzhen. Here’s their home away from home this week.

booth

Bill and Justin have been having a lot of good conversations and have found a lot of interest in an open development community. We’re looking forward to having even more members in Asia soon!

On Monday we released the CrXPRT white paper. If you want to know more about the concepts behind CrXPRT 2015, how it was developed, how the results are calculated, or anything else about CrXPRT, the white paper is a great place to start.
Finally, the MobileXPRT 2015 design document is coming in the next couple of weeks. What would you like to see in the next version of MobileXPRT? 64-bit support? New types of tests? Improvements to the UI? Everything is on the table. This is the time to make your voice heard!
Eric

WebXPRT 2015 Community Preview is available!

As we said yesterday, we’re releasing the community preview of a WebXPRT 2015 Community Preview. Members of the BenchmarkXPRT community can now run the community preview and publish results.

Run the community preview here.

After trying out the community preview, please send in your comments. Either post them to the forum or mail them to benchmarkxprtsupport@principledtechnologies.com. If you mail information that’s of interest to the entire community, we may post an anonymous version of the comments to the forum.

Thanks for being part of the community,

Eric

Finally!

We’re releasing the community preview of WebXPRT 2015 tomorrow. We’re very excited that it’s finally here. In the past few weeks, we’ve discussed some of the new features in WebXPRT 2015, such as test automation, its new and improved tests, and its Chinese UI. We think you’re really going to enjoy the new WebXPRT.

The design document (login required) specifies that WebXPRT will contain an experimental workload. That workload is not in the community preview, although we plan for it to be in the general release. However, because any experimental workloads are not included in the overall score, this will not affect any results you generate.

We’re also investigating the use of the JavaScript navigator object to improve system disclosure, but we are still determining if we can get reliable enough information to display. So this information is not displayed in the community preview.

As with all the BenchmarkXPRT community previews, we’re not putting any publication restrictions on this preview release. Test at will, and publish your findings. We guarantee the results for the community preview will be comparable to results from the general release.

If you’re not a community member, join us and check out the new WebXPRT.

Eric

Check out the other XPRTs:

Forgot your password?