BenchmarkXPRT Blog banner

Author Archives: Eric Hale

Comparing apples and oranges?

My first day at CES, I had breakfast with Brett Howse from AnandTech. It was a great opportunity to get the perspective of a savvy tech journalist and frequent user of the XPRTs.

During our conversation, Brett raised concerns about comparing mobile devices to PCs. As mobile devices get more powerful, the performance and capability gaps between them and PCs are narrowing. That makes it more common to compare upper-end mobile devices to PCs.

People have long used different versions of benchmarks when comparing these two classes of devices. For example, the images for benchmarking a phone might be smaller than those for benchmarking a PC. Also, because of processor differences, the benchmarks might be built differently, say a 16- or 32-bit executable for a mobile device, and a 64-bit version for a PC. That was fine when no one was comparing the devices directly, but can be a problem now.

This issue is more complicated than it sounds. For those cases where a benchmark uses a dumbed-down version of the workload for mobile devices, comparing the results is clearly not valid. However, let’s assume that the workload stays the same, and that you run a 32-bit benchmark on a tablet, and a 64-bit version on a PC. Is the comparison valid? It may be, if you are talking about the day-to-day performance a user is likely to encounter. However, it may not be valid if you are making statement about the potential performance of the device itself.

Brett would like the benchmarking community to take charge of this issue and provide guidance about how to compare mobile devices and PCs. What are your thoughts?

Eric

The XPRT Women Code-a-Thon

As Justin explained last week, we’ve resolved the issue we found with the TouchXPRT CP. I’m happy to say that the testing went well and that we released CP3 this week.

It’s been only three weeks since we announced the XPRT Weekly Tech Spotlight, and we already have another big announcement! Principled Technologies has joined with ChickTech Seattle to host the first ever XPRT Women Code-a-Thon! In this two-day event, participants will compete to create the best new candidate workload for WebXPRT or MobileXPRT. The workloads can’t duplicate existing workloads, so we are looking forward to seeing the new ideas.

Judges will study all the workloads and award prizes to the top three: $2,500 for first place, $1,500 for second place, and $1,000 for third place. Anyone interested can register here.

PT and the BenchmarkXPRT Development Community are committed to promoting the advancement of women in STEM, but we also win by doing good. As with the NCSU senior project, the BenchmarkXPRT Development Community will get some fresh perspectives and some new experimental test tools. Everyone wins!

So much has happened in 2016 and January isn’t even over yet. The year is off to a great start!

Eric

TouchXPRT 2016 Community Preview 3 is available

Today we are releasing TouchXPRT 2016 Community Preview 3 (CP 3). As we discussed in the blog, CP 3 resolves an issue reported on some systems, where the Create Slideshow test would take longer than expected to complete due to the output video not rendering correctly.

As with all community previews, TouchXPRT 2016 CP 3 is available only to community members. Members may download the preview from the TouchXPRT tab in the Members’ Area.

For more details about TouchXPRT 2016, please consult the release notes for further details (login required).

After you try out CP 3, please send us your comments. Either post them to the forum or mail them to BenchmarkXPRTsupport@principledtechnologies.com. If you send us information that’s relevant to the entire community, we may post an anonymous version of your comments to the forum.

Thanks for your participation!

In the spotlight

I’m happy to be back in North Carolina, but I had a really great time at CES. I talked to over a dozen companies about the XPRTs and the XPRT Weekly Tech Spotlight, and had some good conversations. Hopefully, some of these companies’ devices will be among the first ones we showcase when the XPRT Weekly Tech Spotlight goes live next month.

Of course, I saw some really great tech at CES! Amazing TVs and cars, magic mirrors, all kinds of drones, and the list goes on. Before the show, the Internet of Things was predicted to be big this year, and boy, was it! Smart refrigerators, door locks, and thermostats were just the beginning. Some of my favorite examples were the chopsticks and footbath—both Bluetooth enabled—and “the world’s first remote controlled game shoe.”

Clearly IoT is the Wild West of technology right now. We’re had some conversations about how the XPRTs might be able to help consumers navigate the chaos. However, with a class of products this diverse, there are a lot of issues to consider. If you have any thoughts about this, let us know!

Eric

CES day 1

It’s Wednesday night as I’m writing this. CES started in earnest today, and I had a really great day. I saw a lot of cool technology. I really liked the TVs. As I tweeted earlier today, I’m not sure that real life looks that good! That being said, the Ferrari was probably my favorite.

CES Ferrari

I’m not yet convinced about having the family calendar on a tablet embedded in the refrigerator. However, several earnest people made a very good case for it.

This morning PT announced a new program called the XPRT Weekly Tech Spotlight. This is a new way for device vendors and manufacturers to share verified results with buyers around the world. I was happy to talk with a number of different vendors about it and about the XPRTs.

I’ve also met with some community members while I’ve been here. It’s always great to hear from the community, but there’s nothing like being able to sit and talk. The conversations raised some interesting issues, and I’ll be writing about them in future blog posts.

I’m really looking forward to the rest of the show!

Eric

XPRT Weekly Tech Spotlight lets device makers share verified results with consumers

Durham, NC, January 6 –Principled Technologies (PT) is pleased to announce the XPRT Weekly Tech Spotlight, a new way for device vendors and manufacturers to share verified results with buyers around the world.

Every week, XPRT Weekly Tech Spotlight will feature a different tech device and post its PT-verified BenchmarkXPRT performance results and specs online, so buyers everywhere will have the facts they need to make smart buying decisions.

Firms interested in showcasing their products can send their devices to PT for testing. PT will showcase devices to let buyers know how the devices fared. For more information, please contact XPRTSpotlight@PrincipledTechnologies.com or send your device to:

XPRT Weekly Tech Spotlight c/o
Principled Technologies
1007 Slater Road, Suite 300
Durham, NC, 27703

XPRT Weekly Tech Spotlight will make it easier for consumers to shop for a new laptop, smartphone, tablet, or PC.

Results for the debut device will appear in the first week of February at facts.pt/spotlight-devices.

About Principled Technologies, Inc.
Principled Technologies, Inc. is a leading provider of technology marketing and learning & development services. It administers the BenchmarkXPRT Development Community.

Principled Technologies, Inc. is located in Durham, North Carolina, USA. For more information, please visit www.PrincipledTechnologies.com.

Company Contact
Eric Hale
Principled Technologies, Inc.
1007 Slater Road, Suite #300
Durham, NC 27703

Check out the other XPRTs:

Forgot your password?