Google Pixel 8 reviewers stymied by Google's benchmark blockade

Surprisingly, Google has taken the controversial step of preventing reviewers and even new owners of its latest flagship smartphones, the Pixel 8 and Pixel 8 Pro, from running popular benchmarking apps. This unprecedented decision has raised questions about the actual performance capabilities of Google’s custom Tensor G3 chip, which powers these devices.

Benchmarking apps like Geekbench and 3DMark are essential tools in the smartphone review process, providing valuable insights into a device’s CPU and GPU performance. Reviewers use these benchmarks to assess a device objectively and to complement their qualitative analysis based on real-world usage.

Google’s messaging around the Tensor G3 has emphasized its focus on efficiency and AI capabilities rather than raw performance. This has led to concerns about the chip’s relative performance compared to competitors. By blocking access to these benchmark tests through the Google Play Store, Google aimed to limit the exposure of the Tensor G3’s performance metrics.

However, some resourceful individuals with technical expertise managed to circumvent this restriction through a “side-loading” process, allowing benchmark results to surface despite Google’s efforts.

The initial benchmark results for the Tensor G3 on the Pixel 8 Pro were less than flattering. In Geekbench 6, the Tensor G3 scored 1760 in the single-core test and 4442 in the multi-core test. These results were notably lower than the Qualcomm Snapdragon 8 Gen 2, which achieved a single-core score of 2003 and a multi-core score of 5427. These disparities are surprising, considering that both chips use similar Arm-based CPU architectures. The Tensor G3 even boasts an additional mid-core, giving it an edge.

The performance gap can be attributed to Google’s partnership with Samsung, which led to the use of Samsung’s problematic 4 nm node technology for chip fabrication. This technology is less efficient and less dense than the TSMC’s N4P node, which Qualcomm uses for its Snapdragon 8 Gen 2. Similar performance issues were observed in 3D Mark Wild Life Stress tests, revealing concerns about the Tensor G3’s GPU.

Efficiency tests further highlighted that the Tensor G3 falls short of being one of the most efficient performers, comparable to older chips like the Snapdragon 888.

Typically, benchmark results are widely discussed on social media during a smartphone’s launch phase, even during embargo periods. However, Google’s tactics to block benchmarking apps appear partially successful.

In a move that’s equally unusual, Google extended this block to new owners of the Pixel 8 and Pixel 8 Pro, further limiting the spread of performance information.

Pixel enthusiasts argue that outright performance is not the only measure of a smartphone’s worth, highlighting Google’s strengths in software-based AI features, camera quality, and design. However, critics contend that blocking access to benchmark tests suggests a lack of confidence in the Tensor G3’s performance claims, raising concerns about transparency in the smartphone market. If Google were truly confident in its chip, it would not restrict reviewers and users from independently evaluating its capabilities.