BenchmarkXPRT Blog banner

Tag Archives: benchmark

A CloudXPRT build with bug fixes is on the way

Justin Greene
By Justin Greene
on July 9, 2020

We want to let CloudXPRT testers know that updated installer packages are on the way. The packages will include several fixes for bugs that we discovered in the initial CloudXPRT Preview release (build 0.95). The fixes do not affect CloudXPRT test results, but do help to facilitate installation and remove potential sources of confusion during the setup and testing process.

Along with a few text edits and other minor fixes, we made the following changes in the upcoming build:

  • We updated the data analytics setup code to prevent error messages that occurred when the benchmark treated one-node configurations as a special case.
  • We configured the data analytics workload to use a go.mod file for all the required go modules. With this change, we can explicitly state the release version of the necessary go modules, and updates to the latest go release won’t break the benchmark. This change also removes the need to include large gosrc.tar.gz files in the source code.
  • We added a cleanup utility script for the web microservices workload. If something goes wrong during configuration or a test run, testers can use this script to clean everything and start over.
  • We fixed an error that prevented the benchmark from successfully retrieving the cluster_config.json file in certain multi-node setups.
  • In the web microservices workload, we changed the output format of the request rate metric from integer to float. This change allows us to report workload data with a higher degree of precision.
  • In the web microservices workload, we added an overall summary line to results log file that reports the best throughput numbers from the test run.
  • In the web microservices code, we modified a Kubernetes option that the benchmark used to create the Cassandra schema. Prior to this change, the option generated an inconsequential but distracting error message about TTY input.

We haven’t set the release date for the updated build yet, but when we do, we’ll announce it here in the blog. If you have any questions about CloudXPRT, please let us know!

Justin

Posted in benchmark, Benchmarking, BenchmarkXPRT, Cloud, CloudXPRT, data analytics, Kubernetes, Servers, web microservices | Also tagged , , , , , ,

More information about the CloudXPRT results submission process

Justin Greene
By Justin Greene
on May 28, 2020

Earlier this month, we discussed the possibility of using a periodic results submission process for CloudXPRT instead of the traditional rolling publication process that we’ve used for the other XPRTs. We’ve received some positive responses to the idea, and while we’re still working out some details, we’re ready to share the general framework of the process we’re planning to use.

  • We will establish a results review group, which only official BenchmarkXPRT Development Community members can join.
  • We will update the CloudXPRT database with new results once a month, on a pre-published schedule.
  • Two weeks before each publication date, we will stop accepting submissions for consideration for that review cycle.
  • One week before each publication date, we will send an email to the results review group that includes the details of that month’s submissions for review.
  • The results review group will serve as a sanity check process and a forum for comments on the month’s submissions, but we reserve the right of final approval for publication.
  • We will not restrict publishing results outside of the monthly review cadence, but we will not automatically add those results to the results database.
  • We may add externally published results to our database, but will do so only after vetting, and only on the designated day each month.

Our goal is to strike a balance between allowing the tech press, vendors, or other testers to publish CloudXPRT results on their own schedule, and simultaneously building a curated results database that OEMs or other parties can use to compete for the best results.

We’ll share more details about the review group, submission dates, and publications dates soon. Do you have questions or comments about the new process? Let us know what you think!

Justin

Posted in Benchmark metrics, BenchmarkXPRT development community, Cloud, CloudXPRT, Performance benchmarking, results, results submission, Server, Servers, Storage | Also tagged , , , ,

Adapting to a changing tech landscape

Justin Greene
By Justin Greene
on April 23, 2020

The BenchmarkXPRT Development Community started almost 10 years ago with the development of the High Definition Experience & Performance Ratings Test, also known as HDXPRT. Back then, we distributed the benchmark to interested parties by mailing out physical DVDs. We’ve come a long way since then, as testers now freely and easily access six XPRT benchmarks from our site and major app stores.

Developers, hardware manufacturers, and tech journalists—the core group of XPRT testers—work within a constantly changing tech landscape. Because of our commitment to providing those testers with what they need, the XPRTs grew as we developed additional benchmarks to expand the reach of our tools from PCs to servers and all types of notebooks, Chromebooks, and mobile devices.

As today’s tech landscape continues to evolve at a rapid pace, our desire to play an active role in emerging markets continues to drive us to expand our testing capabilities into areas like machine learning (AIXPRT) and cloud-first applications (CloudXPRT). While these new technologies carry the potential to increase efficiency, improve quality, and boost the bottom line for companies around the world, it’s often difficult to decide where and how to invest in new hardware or services. The ever-present need for relevant and reliable data is the reason many organizations use the XPRTs to help make confident choices about their company’s future tech.

We just released a new video that helps to explain what the XPRTs provide and how they can play an important role in a company’s tech purchasing decisions. We hope you’ll check it out!

We’re excited about the continued growth of the XPRTs, and we’re eager to meet the challenges of adapting to the changing tech landscape. If you have any questions about the XPRTs or suggestions for future benchmarks, please let us know!

Justin

Posted in AI, AIXPRT, benchmark, Benchmarking, BenchmarkXPRT, BenchmarkXPRT development community, Chromebooks, Cloud, CloudXPRT, Collaborative benchmark development, Future of performance evaluation, HDXPRT, History of benchmarking, Performance benchmarking | Also tagged , , , , ,

Principled Technologies and the BenchmarkXPRT Development Community release the CrXPRT 2 benchmark for Chromebooks

Justin Greene
By Justin Greene
on April 20, 2020

Durham, NC, April 20— Principled Technologies and the BenchmarkXPRT Development Community have released CrXPRT 2, a free app that measures Chromebook battery life, as well as how fast a Chromebook handles everyday tasks like playing video games, watching movies, editing pictures, and doing homework. Testers can install the app on Chromebooks from the Chrome Web Store or by clicking the Chrome Web Store button on CrXPRT.com.

The CrXPRT 2 performance test, which measures a Chromebook’s speed, gives testers an overall score and individual scores for each workload. In addition to an estimated battery life expressed in hours and minutes, the battery life test produces a separate performance score and a frames per second (FPS) rate for a built-in HTML5 gaming component. CrXPRT is user-friendly, delivering results that consumers can understand.

“CrXPRT is a popular, easy-to-use benchmark run by manufacturers, tech journalists, and consumers all around the world,” said Bill Catchings, co-founder of Principled Technologies, which administers the BenchmarkXPRT Development Community. “CrXPRT 2 continues CrXPRT’s legacy of providing relevant and reliable performance and battery life data for Chrome OS devices.”

CrXPRT is part of the BenchmarkXPRT suite of performance evaluation tools, which includes AIXPRT, CloudXPRT, WebXPRT, TouchXPRT, HDXPRT, and MobileXPRT. The XPRTs help users get the facts before they buy, use, or evaluate tech products such as servers, desktops, laptops, and tablets.

To learn more about the BenchmarkXPRT Development Community, go to www.BenchmarkXPRT.com.

About Principled Technologies, Inc.
Principled Technologies, Inc. is a leading provider of technology marketing and learning & development services. It administers the BenchmarkXPRT Development Community.

Principled Technologies, Inc. is located in Durham, North Carolina, USA. For more information, please visit www.PrincipledTechnologies.com.

Company Contact
Justin Greene
BenchmarkXPRT Development Community
Principled Technologies, Inc.
1007 Slater Road, Ste. 300 Durham, NC 27703
BenchmarkXPRTsupport@PrincipledTechnologies.com

Posted in battery life, benchmark, Benchmark metrics, Benchmarking, BenchmarkXPRT, BenchmarkXPRT development community, Chrome OS, Chromebooks, CrXPRT, Google Chrome, Performance benchmarking, Press Releases | Also tagged , , , , , ,

CrXPRT 2 is here!

Justin Greene
By Justin Greene
on April 16, 2020

We’re excited to announce that CrXPRT 2 is now available to the public! Testers can install the app on Chromebooks by using this link to the Chrome Web Store listing, or by clicking the Chrome Web Store button on CrXPRT.com.

For those who may have missed our previous discussions about what’s new with CrXPRT 2, here is a recap of the key differences between CrXPRT 2015 and CrXPRT 2:

  • CrXPRT 2 has an all-new UI, with a focus on intuitive navigation.
  • The CrXPRT 2 performance test includes six of the seven workloads in CrXPRT 2015. Newer versions of Chrome can’t run the Photo Collage workload without a workaround, so we removed it from CrXPRT 2.
  • We updated the image resolutions and sizes for the Photo Effects and Face Detection workloads.
  • The battery life test now requires a full rundown, so the length of battery life tests will vary according to the battery life of the systems under test.
  • CrXPRT 2 no longer requires testers to enter luminance and audio measurements for battery life tests.
  • We added a second video playback segment to each battery life iteration.


As we’ve noted before, CrXPRT 2 overall performance test scores and battery life measurements are not comparable to CrXPRT 2015 scores. For testers that need to access CrXPRT 2015 for legacy comparison testing, we will continue to make CrXPRT 2015 available via a link on CrXPRT.com.

We appreciate everyone’s input during the CrXPRT 2 development process. If you have any further questions about CrXPRT 2, please let us know!

Justin

Posted in Battery life, benchmark, BenchmarkXPRT, Chrome OS, Chromebooks, CrXPRT, Google Chrome, Laptops, Performance benchmarking | Also tagged , , , ,

The CrXPRT 2 Community Preview is available!

Justin Greene
By Justin Greene
on March 18, 2020

We’re excited to announce that the CrXPRT 2 Community Preview (CP) is now available! BenchmarkXPRT Development Community members can access the preview using a direct link posted on the CrXPRT tab in the XPRT Members’ Area (login required), where they will also find the CrXPRT 2 CP user manual.

You can find more information about the key differences between CrXPRT 2015 and CrXPRT 2 in last week’s blog entry. During the preview period, we allow testers to publish CP test scores, but CrXPRT 2 overall performance test scores and battery life measurements are not comparable to CrXPRT 2015 scores.

If you have any questions about CrXPRT 2 or joining the community, please let us know!

Justin

Posted in Battery life, benchmark, BenchmarkXPRT, BenchmarkXPRT development community, Chrome OS, Chromebooks, Community Preview, CrXPRT, Google Chrome | Also tagged , , , , , , ,

Check out the other XPRTs:

Forgot your password?
© Principled Technologies, Inc. 2025   |   Privacy policy

Cookie Notice: Our website uses cookies to deliver a smooth experience by storing logins and saving user information. By continuing to use our site, you agree with our usage of cookies as our privacy policy outlines.

x