Category: Benchmarking

More grease, more tracks

on March 27, 2014

We’re always looking for ways to make it easier for people to use the benchmarks and interact with the community. I wrote about a new form for suggesting new benchmarks last week. However, we are not stopping there.

Although the community previews for TouchXPRT 2014 and BatteryXPRT 2014 for Android have been out for a few weeks, we’ve continued to improve them before their general releases. For example, we mentioned in TouchXPRT CP1 that we would continue making changes to the UI.

Taking a cue from WebXPRT 2013, the upcoming general releases of TouchXPRT 2014 and BatteryXPRT 2014 for Android will have a button in the UI for submitting results. This will make it easier for you to submit your results to be approved for publication on the PT Web site.

Although there’s not much time left before the general releases of these benchmarks, it’s not too late to send in your ideas. Even if we can’t use your suggestions in this release, we may be able to use them in the future. Let us know what you think by posting to the forum or emailing us at BenchmarkXPRTsupport@principledtechnologies.com.

Eric

Comment on this post in the forums

Posted in BatteryXPRT 2014 for Android, Collaborative benchmark development, Community Preview, Let us know your thoughts, TouchXPRT, TouchXPRT 2014, WebXPRT |

Greasing the track

By Eric Hale

on March 20, 2014

While BatteryXPRT 2014 for Android may still be in its community preview stage, we’re already looking for the next great XPRT. As we’ve said in the past, there’s always something new to measure. That’s where you come in − we want to hear about the benchmarks you want to see!

To make it easier for Community members to send us their ideas, we’ve made a form available in the member’s area. All members have to do is click Have an idea for a new XPRT? and fill in a description. This form saves you the trouble of composing an e-mail and makes it easier for us to track community interest.

However, even though we’re making life simpler for members of the community, anyone can suggest a new benchmark. If you have a good idea or any other comments you want us to hear, just send an e-mail to BenchmarkXPRTsupport@principledtechnologies.com. We also hope you’ll consider joining the community.

There’s a lot of new technology out there, and we’re very excited about upcoming possibilities. Speaking of new technology, check out Bill’s new blog, Tech Everywhere. He’s already written about electric cars, smart watches and a Bluetooth-enabled electric toothbrush. It’s definitely worth a read.

Eric

Comment on this post in the forums

Posted in Battery life, BatteryXPRT 2014 for Android, BenchmarkXPRT development community, Collaborative benchmark development, Community Preview |

It’s always worth asking

By Eric Hale

on March 6, 2014

Last week, one of our community members asked for a couple of enhancements to WebXPRT. They wanted WebXPRT to be easier to automate, and they made two specific requests:

Add debug/result logs
Add the ability to start the test without UI interactions, by using a specific URL or a command line

This is a great example of why we put so much emphasis on the community. We have tried to make the BenchmarkXPRT benchmarks easy to use, but we don’t always face the same testing demands you do. If there’s anything we can do to make these tools more valuable, please let us know by posting on the forums or e-mailing us at benchmarkxprtsupport@principledtechnologies.com.

We are adding those abilities to the upcoming WebXPRT 2014 community preview. Speaking of the community preview, we have been working hard on it, and in the next few weeks, we’ll be talking about what will be in it.

Keep those requests coming!

Eric

Comment on this post in the forums

Posted in BenchmarkXPRT development community, Collaborative benchmark development, Community Preview, WebXPRT, What makes a good benchmark? |

Golden tickets go global

By Bill Catchings

on February 27, 2014

I’ve spent the last week at Mobile World Congress (MWC) in Barcelona. The show is somewhat reminiscent of CES in January, but with a much more European/global feel. There are seven large halls of booths with phones, tablets, accessories, and gadgets of every sort.

I have felt Fujitsu’s haptic technology on a tablet, seen phones operating under water such as Kyocera’s and others, and even talked with someone at Oral-B about their Bluetooth-enabled electric toothbrush.

As at CES , my primary goal has not been to play with cool gadgets, see the sights, and eat good food. (Though, admittedly, all of that has been fun!) Instead, I was here to spread the word about the XPRT benchmarks. I handed out more of the special golden tickets that invite folks to be heard by joining the BenchmarkXPRT community and to take advantage of the opportunity to have PT test devices for free with all the applicable XPRT benchmarks.

If you were not able to attend CES or MWC, or I missed you and did not give you a golden ticket (or one of our cool shirts), please contact us. We don’t want any members of the community to feel left out! And, we’d love any of the rest of you readers to join the community and be part of creating the benchmarks for the next wave of cool phones, tablets, and devices.

-Bill Catchings

Comment on this post in the forums

Posted in BenchmarkXPRT development community, CES, Collaborative benchmark development, Golden Tickets, Mobile World Congress, Uncategorized |

MWC is coming

By Eric Hale

on February 20, 2014

As you probably know, the Mobile World Congress (MWC) starts Monday in Barcelona. Bill loves gadgets, loves Barcelona, and loves talking about technology, so he’s really looking forward to being there.

Bill’s got a lot to talk about. In January, we released the first community preview for TouchXPRT 2014. Then on February 7, 2014, we released the first community preview for a brand new benchmark: BatteryXPRT 2014 for Android. Not only that, HDXPRT and WebXPRT are in development. And he always loves to hear about new areas where you are interested in having benchmarks.

And that’s not all – If you read Bill and Mark’s post about being at CES, you’ll be happy to know that the Golden Tickets are back! The Golden Tickets let you join the community and get your device tested for free. If you’re a mobile device manufacturer, be sure to find Bill to get yours.

If you want to meet with Bill, send an e-mail to BenchmarkXPRTsupport@principledtechnologies.com. You can also DM us on Twitter at @BenchmarkXPRT.

We hope to see you there!

Eric

Comment on this post in the forums

Posted in BatteryXPRT 2014 for Android, CES, Collaborative benchmark development, Community Preview, Mobile World Congress, TouchXPRT 2014 |

BatteryXPRT 2014 for Android CP1

By Eric Hale

on February 13, 2014

Last week we released the BatteryXPRT 2014 for Android Community Preview 1 (CP1). As I said in last week’s blog, You wanted it? You got it!, you are free to publish results from this community preview.

We hope you’ll submit results to be published in the BatteryXPRT database. You’ll find the file containing your results in the Android\data\com.batteryxprt\BatteryXPRT\results directory on the SD card of your device. The results directory will contain a time-stamped directory for each run – for example, “2014Feb11142239.” You’ll find a file named Results.xml in the appropriate time-stamped directory. To submit a result, just e-mail the Results.xml file from your run to BenchmarkXPRTsupport@principledtechnologies.com.

The benchmark includes a user manual in the UI. In addition to the benchmark itself, you can also find installation instructions and a design overview in the member’s area.

We’ll make the source code for the community preview available in the next few days.

Given the diversity and changing nature of Android devices, we expect that you may run into some issues. As with any of our community previews, if you encounter any issues, please let us know so we can continue to improve the benchmark as we prepare it for release.

Community previews are only available to community members. If you are not a member, this a great time to join.

After you’ve downloaded CP1, let us know what you think by posting to the forum or e-mailing us at BenchmarkXPRTsupport@principledtechnologies.com.

Eric

Comment on this post in the forums

Posted in Android, BatteryXPRT 2014 for Android, Collaborative benchmark development, Community Preview |

Category: Benchmarking

More grease, more tracks

Greasing the track

It’s always worth asking

Golden tickets go global

MWC is coming

BatteryXPRT 2014 for Android CP1

Check out the other XPRTs: