REDMAGIC 11 Pro Delisted from 3DMark After Benchmark Manipulation Detection
UL Solutions has delisted Nubia's REDMAGIC 11 Pro gaming phones from the 3DMark benchmark database after testing revealed significant performance manipulation, with the devices delivering much higher scores in the standard benchmark app compared to disguised versions.
What Happened
- UL Solutions delisted the REDMAGIC 11 Pro from 3DMark
- A YouTube channel (Saityo) discovered the phone scored much higher on the standard 3DMark app vs. a disguised version
- The disguised version reached temperatures 15 degrees Celsius lower than the standard test
- The standard stress test caused the phone to shut down at 55 degrees Celsius due to thermal limits
Nubia's Response
Nubia defended the practice by stating:
- REDMAGIC devices offer multiple performance modes for different use cases
- "Diablo Mode" is designed to maximize performance under demanding conditions
- The device dynamically assesses application load and allocates resources accordingly
- Benchmarking is viewed as an indicator of "performance potential under controlled, high-load conditions"
Why This Matters
While identifying specific apps for performance tuning is legitimate (for responsiveness, temperature management, and battery life), detecting benchmark apps to deliver unthrottled performance that doesn't represent real-world usage is widely considered cheating:
- Users will never experience benchmark-level performance in actual games or apps
- The device reached thermal shutdown in the standard test -- despite having built-in cooling fans and liquid cooling
- Results in the disguised version represent actual sustained performance users would get
Industry Context
Benchmark manipulation has been a recurring issue in the Android ecosystem. Multiple manufacturers have been caught over the years boosting performance specifically for benchmark detection. The practice undermines consumer trust in comparative performance data and makes it harder for buyers to make informed purchasing decisions.
UL Solutions' delisting is a meaningful enforcement action that signals continued vigilance against benchmark manipulation in the mobile industry.