Category: CrXPRT

They’re coming!

on June 16, 2016

We’ve been hearing for a while about Google’s plan to bring Android apps to Chrome. They recently published a video on the Google Developers channel that gives us some idea of what running Android apps on a Chromebook would look like.

Because I’m very interested in performance, the claim “Android apps can run full speed, with no overhead and no performance penalties” got my attention. You can bet we’ll be using the XPRTs to check that out! We’re using a Google developer tool called ARC Welder to do some experiments. However, it’s not fair or valid to print performance results based on a developer tool, so we’ll have to wait until the official release to see what the performance is really like.

Obviously, the use cases for Chrome will be changing. The demos in the video are for workloads we associate with PCs. MobileXPRT-type workloads might be more appropriate, or, assuming the scripting tools are available, perhaps HDXPRT-type workloads. We’ll be watching these developments closely to see how they will affect our future cross-platform benchmark.

Eric

Posted in Android, Chrome OS, Chromebooks, Google Chrome, HDXPRT, MobileXPRT, PCs |

Ready for your closeup?

By Eric Hale

on June 9, 2016

On January 6, we announced the XPRT Weekly Tech Spotlight. We spotlighted the first device, a Google Pixel C, on February 8. Since then, we’ve spotlighted around 20 devices, and the list keeps growing with phones, tablets, Chromebooks, and laptops. The XPRT Weekly Tech Spotlight has been a big success and is one of our most visited pages.

From the beginning, we’ve offered to spotlight your device for free, though we will need to keep the device to allow for retesting with future versions of the OS and benchmarks. Any device you contribute jumps to the head of the queue, and will be in the Spotlight the following week. We have a page for vendors with all the details.

As we continue to spotlight new devices, we are thinking about ways to allow you to compare their specs and XPRT results. We would love to hear your thoughts on what capabilities would be useful to you in those comparisons.

Looking forward to seeing your device in the spotlight soon!

Eric

Posted in Chromebooks, Laptops, Phones, Tablets, XPRT Weekly Tech Spotlight |

Five years later…

By Bill Catchings

on November 6, 2015

Five years ago this month, we started what we then called the HDXPRT Development Community. The first benchmark, HDXPRT 2011, appeared six months later. A LOT has happened since then.

We’ve grown to six benchmarks (HDXPRT, TouchXPRT, WebXPRT, MobileXPRT, BatteryXPRT, and CrXPRT) with plenty of updates. As a result, we had to change the name to the BenchmarkXPRT Development Community, though we’ve come to refer to the benchmarks themselves as the XPRTs.

To tell the world about the XPRTs and the BenchmarkXPRT Development Community, we’ve written over 200 blog entries. We’ve created videos, a training course, infographics, and white papers. We’ve met members of the community at their companies, via webinars, and at trade shows. We’ve quite literally traveled around the world to shows in Las Vegas, Barcelona, Taipei, and Shenzhen.

As a result, the community has grown to about 150 individuals at over 60 companies and organizations. People have downloaded or run the benchmarks over 100,000 times in over 44 countries. The XPRTs have been cited over 3,800 times in a wide variety of websites around the world.

Yes, a lot has happened over these five years.

On behalf of the BenchmarkXPRT team, I want to convey my sincere thanks to all of you for your involvement over these years. I’m really looking forward to what the next five years will look like. We’re just getting started!

Posted in BatteryXPRT 2014 for Android, BenchmarkXPRT, BenchmarkXPRT development community, CrXPRT, HDXPRT, HDXPRT Development Community benefits, MobileXPRT, TouchXPRT, WebXPRT |

Time for a merger of equals?

By Eric Hale

on April 16, 2015

As I said last week, we’re working on the design document for the new version of MobileXPRT, and we expect to have it out in the next couple of weeks. We have several ideas we’re pretty excited about.

One of the ideas we’ve been considering is merging BatteryXPRT and MobileXPRT into a single benchmark. This would be similar to what we’ve done with CrXPRT, which has tests for both battery life and performance. As with CrXPRT, you’d be able to run either test, and you could get performance and battery life for a device in a single day using a single benchmark.

If we as the community do decide to merge the benchmarks, there will be a lot to think about. For example, MobileXPRT is unaware whether it’s connected to the Internet, while BatteryXPRT not only detects how it’s connected, but selects the appropriate Airplane mode or Network-Wifi Mode test. And, of course, we’d have to figure out what to call it.

What do you think about merging the two benchmarks? Would it make your life simpler? What other features would you like to see in the new MobileXPRT? This is the time to speak up!

Eric

Posted in Battery life, BatteryXPRT 2014 for Android, BenchmarkXPRT development community, Collaborative benchmark development, CrXPRT, Future of performance evaluation, MobileXPRT |

Lots of things are happening!

By Eric Hale

on April 9, 2015

The WebXPRT 2015 community preview hasn’t even been out two weeks yet, but there are already hundreds of runs in the database. If you haven’t checked it out yet, now is a good time! (login required)

As I mentioned last week, Bill and Justin are at Intel Developer Forum 2015 – Shenzhen. Here’s their home away from home this week.

Bill and Justin have been having a lot of good conversations and have found a lot of interest in an open development community. We’re looking forward to having even more members in Asia soon!

On Monday we released the CrXPRT white paper. If you want to know more about the concepts behind CrXPRT 2015, how it was developed, how the results are calculated, or anything else about CrXPRT, the white paper is a great place to start.
Finally, the MobileXPRT 2015 design document is coming in the next couple of weeks. What would you like to see in the next version of MobileXPRT? 64-bit support? New types of tests? Improvements to the UI? Everything is on the table. This is the time to make your voice heard!
Eric

Posted in CrXPRT, IDF, Principled Technologies, WebXPRT, WebXPRT 2015, White papers |

A couple of things

By Eric Hale

on April 2, 2015

We’ve heard about a couple of issues this week. The HDXPRT 2014 Convert Videos test uses the MediaEspresso application and requires hardware acceleration be configured. On some systems, this setting is not configuring automatically, which may result in lower scores. We’re working on a solution, but in the meantime there’s an easy workaround.

We’ve also found that some Chromebooks report extremely low battery use, as low as 0%, for the first couple iterations of the CrXPRT battery life test. This can cause CrXPRT to report results with a very wide confidence interval, with an interval greater than 15%. We’re looking at ways to detect and compensate for this. However, if you see results with a very wide confidence interval, we recommend that you use the rundown test.

In other news, we’ve been talking about Intel Developer Forum 2015 – Shenzhen for weeks, and the time is finally here! Bill and Justin get on the plane tomorrow. If you’d like to talk about the XPRTs, or any of PT’s other offerings, Bill and the team would be happy to meet with you!

Eric

Posted in Collaborative benchmark development, CrXPRT, Google Chrome, HDXPRT, IDF |

Category: CrXPRT

They’re coming!

Ready for your closeup?

Five years later…

Time for a merger of equals?

Lots of things are happening!

A couple of things

Check out the other XPRTs: